00000001:02000400:1.0F:1787764704.885691:0:2961:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1787764715.288950:0:3163:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1787764716.667258:0:3226:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 466 MB/s 00000001:01000000:3.0:1787764716.918372:0:3226:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 406 MB/s 00000001:01000000:0.0F:1787764717.168148:0:3226:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3223 MB/s 00000020:02000000:1.0:1787764717.686777:0:3255:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_118_g5fc7b69 00000400:02000000:1.0:1787764718.251906:0:3270:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.202.153@tcp [8/256/0/180] 00008000:02000000:0.0:1787764721.191793:0:3419:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1787764748.792677:0:5221:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787764753.841813:0:5789:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787764753.841816:0:5789:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1787764753.841895:0:5789:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000089990f3 00000080:02000400:0.0:1787764753.841902:0:5789:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1787764753.843553:0:5789:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1787764753.843559:0:5789:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787764753.843576:0:5789:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000b937bcd0) 00000020:00000080:0.0:1787764753.843586:0:5789:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787764753.850513:0:5789:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787764753.850822:0:5789:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787764753.862129:0:5789:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787764753.862161:0:5789:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787764753.862179:0:5789:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787764753.862221:0:5789:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787764753.862240:0:5789:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787764753.862531:0:5789:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787764753.862538:0:5789:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787764753.862546:0:5789:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdf82b4f42fb378c2 00000020:01000004:3.0:1787764753.862552:0:5789:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787764753.862556:0:5789:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787764753.862559:0:5789:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000089990f3 from MGS 00000020:01000004:3.0:1787764753.862563:0:5789:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787764753.862578:0:5789:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000cedff719) 00000020:00000080:3.0:1787764753.862588:0:5789:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787764753.862644:0:5789:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000089990f3 from MGS, refs=2 00080000:01000000:3.0:1787764753.862650:0:5789:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787764753.862661:0:5789:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdf82b4f42fb378d0 00000100:00100000:3.0:1787764753.862757:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787764753.862894:0:5789:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787764753.862904:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787764753.863192:0:5789:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787764753.863197:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787764753.863613:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787764753.863704:0:5789:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787764753.863708:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787764753.864070:0:5789:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787764753.864099:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787764753.864445:0:5789:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787764753.864450:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787764753.864790:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764753.864793:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764753.864795:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764753.864948:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764753.864951:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764753.864953:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764753.865282:0:5789:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787764753.868160:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1787764754.115245:0:5789:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 6643 MB/s 00000001:01000000:3.0:1787764754.365172:0:5789:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 7759 MB/s 00000001:01000000:3.0:1787764754.615258:0:5789:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1359 MB/s 00000001:01000000:2.0:1787764754.865464:0:5789:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1591 MB/s 00080000:10000000:2.0:1787764754.870637:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1787764754.878995:0:5789:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787764754.879010:0:5789:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787764754.879013:0:5789:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1787764754.881394:0:5801:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787764754.881445:0:5789:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787764754.881491:0:5789:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1787764754.881677:0:5789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787764754.881704:0:5789:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787764754.882052:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787764754.882317:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787764754.882324:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787764754.882780:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787764754.882786:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787764754.883168:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787764754.883182:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787764754.884045:0:5789:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787764754.884063:0:5789:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.153@tcp' 00000020:01000004:3.0:1787764754.884065:0:5789:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787764754.884131:0:5789:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.153@tcp (typ=mgc) 00000020:00000080:3.0:1787764754.884141:0:5789:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.153@tcp (00000000035febbf) 00000020:00000080:3.0:1787764754.884155:0:5789:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787764754.884235:0:5789:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000091d6a1f5@MGC192.168.202.153@tcp: add connection 192.168.202.153@tcp at head 00010000:00010000:3.0:1787764754.884416:0:5789:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.153@tcp-0 is initialized 00000040:01000000:3.0:1787764754.884423:0:5789:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.153@tcp ctxt 1 is initialized 00000100:00080000:2.0:1787764754.885273:0:5805:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1787764754.885573:0:5806:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787764754.885658:0:5789:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.153@tcp (uuid 4ce65d8b-33b1-4c9d-a39f-9953ad302d03) 00000020:00000080:2.0:1787764754.885687:0:5789:0:(genops.c:1385:class_connect()) connect: client 4ce65d8b-33b1-4c9d-a39f-9953ad302d03, cookie 0xdf82b4f42fb378de 00000100:00080000:2.0:1787764754.885696:0:5789:0:(import.c:510:import_select_connection()) MGC192.168.202.153@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787764754.885701:0:5789:0:(import.c:624:import_select_connection()) MGC192.168.202.153@tcp: import 0000000091d6a1f5 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:2.0:1787764754.885730:0:5789:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000095c94dd3 x1874607176941696/t0(0) o250->MGC192.168.202.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787764754.885826:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000095c94dd3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3285:1874607176941696:0@lo:250: 00000100:00100000:0.0:1787764754.885891:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787764754.885955:0:5789:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 4ce65d8b-33b1-4c9d-a39f-9953ad302d03->MGS 00000020:01000004:2.0:1787764754.885972:0:5789:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787764754.885976:0:5789:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787764754.885993:0:5789:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000c4d6038d) 00000020:00000080:2.0:1787764754.886004:0:5789:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1787764754.886386:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176941696 00000100:00100000:1.0:1787764754.886393:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176941696 00000100:00100000:1.0:1787764754.886428:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787764754.886435:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a20d57d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3285:x1874607176941696:12345-0@lo:250: 00010000:00080000:1.0:1787764754.886455:0:5802:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 4ce65d8b-33b1-4c9d-a39f-9953ad302d03@0@lo t0 exp 0000000000000000 cur 93 last 0 00000020:00000080:1.0:1787764754.886477:0:5802:0:(genops.c:1385:class_connect()) connect: client 4ce65d8b-33b1-4c9d-a39f-9953ad302d03, cookie 0xdf82b4f42fb378ec 00000100:00080000:1.0:1787764754.886598:0:5802:0:(import.c:65:import_set_state_nolock()) 00000000244fc4dd : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787764754.888810:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a20d57d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+5:3285:x1874607176941696:12345-0@lo:250: Request processed in 2369us (2913us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764754.888824:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787764754.889211:0:3285:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.153@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787764754.889224:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.153@tcp: connect to target with instance 0 00000100:00080000:0.0:1787764754.889232:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.153@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787764754.889237:0:3285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787764754.889248:0:3285:0:(import.c:65:import_set_state_nolock()) 0000000091d6a1f5 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787764754.889252:0:3285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787764754.889261:0:3285:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787764754.889268:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000095c94dd3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3285:1874607176941696:0@lo:250: 00000100:00100000:2.0:1787764754.897455:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787764754.897664:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787764754.897687:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787764754.898466:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787764754.898474:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787764754.901129:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787764754.901139:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787764754.901897:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787764754.902068:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787764754.902113:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00010000:00010000:2.0:1787764754.903310:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764754.903350:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787764754.903358:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1787764754.943055:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787764754.943500:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787764754.943507:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787764754.944720:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787764754.944728:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787764754.945609:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787764754.945780:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787764754.945785:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787764754.946717:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787764754.946725:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787764754.947459:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787764754.947598:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787764754.947603:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787764754.948661:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787764754.948678:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787764754.950930:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787764754.951440:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787764754.951446:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787764754.953453:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787764754.953464:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787764754.993263:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787764754.993577:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787764754.993584:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787764754.995704:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787764754.995717:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787764754.998260:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787764754.998273:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787764755.000168:0:5789:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787764755.000318:0:5789:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1787764755.000329:0:5789:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.153@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787764755.000448:0:5789:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.153@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787764755.000481:0:5789:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.153@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1787764755.000486:0:5789:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787764755.000487:0:5789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787764755.000488:0:5789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787764755.000490:0:5789:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787764755.000491:0:5789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787764755.000492:0:5789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787764755.000493:0:5789:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787764755.000495:0:5789:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787764755.000496:0:5789:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787764755.000497:0:5789:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787764755.000499:0:5789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787764755.000500:0:5789:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787764755.000502:0:5789:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1787764755.000505:0:5789:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787764755.000506:0:5789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787764755.000507:0:5789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787764755.000508:0:5789:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787764755.000509:0:5789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787764755.000510:0:5789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787764755.000511:0:5789:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787764755.000511:0:5789:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787764755.000512:0:5789:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787764755.000513:0:5789:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787764755.000514:0:5789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787764755.000515:0:5789:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787764755.000548:0:5789:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787764755.000567:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000194e12e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5789:1874607176941824:0@lo:253: 00000100:00100000:3.0:1787764755.000643:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764755.000751:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 00000000adf377bc going to sleep for 11 seconds 00000100:00100000:3.0:1787764755.000953:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176941824 00000100:00100000:3.0:1787764755.000959:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176941824 00000100:00100000:3.0:1787764755.001004:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787764755.001077:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b07e6f79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+5:5789:x1874607176941824:12345-0@lo:253: 20000000:01000000:3.0:1787764755.001272:0:5804:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787764755.001275:0:5804:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1787764755.001605:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787764755.001646:0:5804:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1787764755.001895:0:5804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787764755.002605:0:5825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1787764755.002706:0:5804:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787764755.002710:0:5804:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1787764755.002714:0:5804:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1787764755.002717:0:5804:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1787764755.002784:0:5804:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1787764755.002926:0:5804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787764755.003342:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1787764755.003356:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787764755.003400:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1787764755.003447:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1787764755.003485:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1787764755.003567:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1787764755.003576:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1787764755.003618:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1787764755.003626:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1787764755.003654:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1787764755.003661:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1787764755.003867:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1787764755.003921:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1787764755.003950:0:5804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787764755.003956:0:5804:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1787764755.003969:0:5804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787764755.004404:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1787764755.004415:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787764755.004448:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1787764755.004484:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1787764755.004541:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1787764755.004554:0:5804:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1787764755.004635:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1787764755.004644:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787764755.004718:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1787764755.004872:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1787764755.004915:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1787764755.004926:0:5804:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1787764755.005072:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1787764755.005282:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1787764755.005323:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1787764755.005358:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1787764755.005518:0:5804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1787764755.005562:0:5804:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1787764755.005569:0:5804:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1787764755.005967:0:5826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1787764755.006115:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1787764755.006132:0:5804:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.153@tcp for mdt 20000000:01000000:0.0:1787764755.006133:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.153@tcp (null) (null) (null) 00000040:00080000:0.0:1787764755.006153:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1787764755.006159:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787764755.006187:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1787764755.006195:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.153@tcp (null) (null) 00000040:00080000:0.0:1787764755.006523:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1787764755.006535:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787764755.006567:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1787764755.006602:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1787764755.006651:0:5804:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787764755.006653:0:5804:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787764755.006657:0:5804:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787764755.006688:0:5804:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787764755.006690:0:5804:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787764755.006711:0:5804:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787764755.006712:0:5804:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787764755.007007:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1787764755.007311:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1787764755.007336:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1787764755.007353:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1787764755.007359:0:5804:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787764755.007360:0:5804:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787764755.007594:0:5828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1787764755.007733:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1787764755.007769:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1787764755.007827:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:0.0:1787764755.007846:0:5804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787764755.007849:0:5804:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1787764755.007852:0:5804:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787764755.007853:0:5804:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787764755.007858:0:5804:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1787764755.007863:0:5804:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1787764755.008136:0:5829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1787764755.008176:0:5804:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1787764755.011920:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1787764755.012037:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1787764755.012231:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1787764755.012256:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787764755.012276:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000019b7d34e/0xdf82b4f42fb378f3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764755.012292:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000019b7d34e/0xdf82b4f42fb378f3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764755.012302:0:5804:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000019b7d34e/0xdf82b4f42fb378f3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764755.012309:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000019b7d34e/0xdf82b4f42fb378f3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764755.012316:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000019b7d34e/0xdf82b4f42fb378f3 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764755.012323:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000019b7d34e/0xdf82b4f42fb378f3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764755.012328:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000019b7d34e already unused, calling callback (00000000ae94d9b2) 00010000:00010000:3.0:1787764755.012332:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000019b7d34e/0xdf82b4f42fb378f3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764755.012339:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000019b7d34e/0xdf82b4f42fb378f3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764755.012363:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000019b7d34e/0xdf82b4f42fb378f3 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764755.012372:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000019b7d34e/0xdf82b4f42fb378f3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764755.012378:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000019b7d34e/0xdf82b4f42fb378f3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787764755.012464:0:5804:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787764755.104919:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b07e6f79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+5:5789:x1874607176941824:12345-0@lo:253: Request processed in 103903us (104272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764755.104931:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787764755.104950:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000194e12e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5789:1874607176941824:0@lo:253: 10000000:01000000:3.0:1787764755.104969:0:5789:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787764755.104972:0:5789:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787764755.104974:0:5789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787764755.104976:0:5789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787764755.104977:0:5789:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1787764755.104978:0:5789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787764755.104980:0:5789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787764755.104981:0:5789:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787764755.104982:0:5789:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787764755.104984:0:5789:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787764755.104985:0:5789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787764755.104986:0:5789:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787764755.105006:0:5789:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000089990f3 from lustre-MDT0000 10000000:01000000:3.0:1787764755.105037:0:5789:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787764755.105040:0:5789:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787764755.105044:0:5789:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9dfcc4e21a48 10000000:01000000:3.0:1787764755.105048:0:5789:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787764755.105055:0:5789:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9dfcc4e21a48 from 1 10000000:01000000:3.0:1787764755.105058:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787764755.105115:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: 0000000019b7d34e/0xdf82b4f42fb378fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764755.105136:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: 0000000019b7d34e/0xdf82b4f42fb378fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764755.105145:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: 0000000019b7d34e/0xdf82b4f42fb378fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764755.105162:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000194e12e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5789:1874607176941952:0@lo:101: 00000100:00100000:3.0:1787764755.105197:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764755.105247:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176941952 00000100:00100000:1.0:1787764755.105255:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176941952 00000100:00100000:3.0:1787764755.105255:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a08fc31c going to sleep for 11 seconds 00000100:00100000:1.0:1787764755.105310:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787764755.105319:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000000f1d4b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+5:5789:x1874607176941952:12345-0@lo:101: 00010000:00010000:1.0:1787764755.105333:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787764755.105346:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002a9200cf/0xdf82b4f42fb37901 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb378fa expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764755.105367:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002a9200cf/0xdf82b4f42fb37901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb378fa expref: 6 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764755.105377:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002a9200cf/0xdf82b4f42fb37901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb378fa expref: 6 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764755.105386:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002a9200cf, rc 0) 00000100:00100000:1.0:1787764755.105422:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000000f1d4b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+6:5789:x1874607176941952:12345-0@lo:101: Request processed in 104us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764755.105438:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787764755.105443:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000194e12e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5789:1874607176941952:0@lo:101: 00010000:00010000:3.0:1787764755.105459:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: 0000000019b7d34e/0xdf82b4f42fb378fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37901 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764755.105467:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: 0000000019b7d34e/0xdf82b4f42fb378fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf82b4f42fb37901 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764755.105508:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000194e12e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5789:1874607176942080:0@lo:501: 00000100:00100000:3.0:1787764755.105534:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764755.105550:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a08fc31c going to sleep for 11 seconds 00000100:00100000:2.0:1787764755.105563:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176942080 00000100:00100000:2.0:1787764755.105568:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176942080 00000100:00100000:2.0:1787764755.105594:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787764755.105597:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000286c68e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+6:5789:x1874607176942080:12345-0@lo:501: 00000100:00100000:2.0:1787764755.105738:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000286c68e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+6:5789:x1874607176942080:12345-0@lo:501: Request processed in 140us (205us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787764755.105745:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787764755.105761:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000194e12e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5789:1874607176942080:0@lo:501: 10000000:01000000:3.0:1787764755.105789:0:5789:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787764755.105801:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: 0000000019b7d34e/0xdf82b4f42fb378fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37901 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764755.105808:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: 0000000019b7d34e/0xdf82b4f42fb378fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37901 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787764755.105826:0:5789:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dfce623b000 10000000:01000000:3.0:1787764755.105830:0:5789:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787764755.105833:0:5789:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9dfce623b000 10000000:01000000:3.0:1787764755.105836:0:5789:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787764755.105839:0:5789:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9dfce623b000 from 1 10000000:01000000:3.0:1787764755.105841:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787764755.105854:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: 000000008ac28371/0xdf82b4f42fb37908 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764755.105861:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: 000000008ac28371/0xdf82b4f42fb37908 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764755.105867:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: 000000008ac28371/0xdf82b4f42fb37908 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764755.105877:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000194e12e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5789:1874607176942208:0@lo:101: 00000100:00100000:3.0:1787764755.105901:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764755.105917:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a08fc31c going to sleep for 11 seconds 00000100:00100000:1.0:1787764755.105945:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176942208 00000100:00100000:1.0:1787764755.105949:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176942208 00000100:00100000:1.0:1787764755.105977:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787764755.105984:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000527ec21e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+6:5789:x1874607176942208:12345-0@lo:101: 00010000:00010000:1.0:1787764755.105992:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787764755.106000:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004d456137/0xdf82b4f42fb3790f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb37908 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764755.106014:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004d456137/0xdf82b4f42fb3790f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb37908 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764755.106021:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004d456137/0xdf82b4f42fb3790f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37908 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764755.106027:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004d456137, rc 0) 00000100:00100000:1.0:1787764755.106062:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000527ec21e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+7:5789:x1874607176942208:12345-0@lo:101: Request processed in 79us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764755.106068:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787764755.106109:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000194e12e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5789:1874607176942208:0@lo:101: 00010000:00010000:3.0:1787764755.106121:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: 000000008ac28371/0xdf82b4f42fb37908 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb3790f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764755.106128:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: 000000008ac28371/0xdf82b4f42fb37908 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf82b4f42fb3790f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787764755.106137:0:5789:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787764755.106149:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: 000000008ac28371/0xdf82b4f42fb37908 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb3790f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764755.106166:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: 000000008ac28371/0xdf82b4f42fb37908 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb3790f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787764755.106172:0:5789:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787764755.106175:0:5789:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787764755.106179:0:5789:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9dfce623b000 10000000:01000000:3.0:1787764755.106182:0:5789:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787764755.106185:0:5789:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787764755.106187:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787764755.106202:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: 00000000df34ab74/0xdf82b4f42fb37916 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764755.106208:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: 00000000df34ab74/0xdf82b4f42fb37916 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764755.106214:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: 00000000df34ab74/0xdf82b4f42fb37916 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764755.106225:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000194e12e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5789:1874607176942336:0@lo:101: 00000100:00100000:3.0:1787764755.106248:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764755.106271:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a08fc31c going to sleep for 11 seconds 00000100:00100000:2.0:1787764755.106285:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176942336 00000100:00100000:2.0:1787764755.106289:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176942336 00000100:00100000:2.0:1787764755.106308:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787764755.106312:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006fe2481c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+7:5789:x1874607176942336:12345-0@lo:101: 00010000:00010000:2.0:1787764755.106319:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764755.106328:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000febc8868/0xdf82b4f42fb3791d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb37916 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764755.106342:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000febc8868/0xdf82b4f42fb3791d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb37916 expref: 8 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764755.106350:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000febc8868/0xdf82b4f42fb3791d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37916 expref: 8 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764755.106357:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000febc8868, rc 0) 00000100:00100000:2.0:1787764755.106381:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006fe2481c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+8:5789:x1874607176942336:12345-0@lo:101: Request processed in 69us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764755.106386:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787764755.106407:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000194e12e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5789:1874607176942336:0@lo:101: 00010000:00010000:3.0:1787764755.106417:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: 00000000df34ab74/0xdf82b4f42fb37916 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb3791d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764755.106423:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: 00000000df34ab74/0xdf82b4f42fb37916 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf82b4f42fb3791d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764755.106466:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000194e12e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5789:1874607176942464:0@lo:501: 00000100:00100000:3.0:1787764755.106490:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764755.106506:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a08fc31c going to sleep for 11 seconds 00000100:00100000:1.0:1787764755.106521:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176942464 00000100:00100000:1.0:1787764755.106527:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176942464 00000100:00100000:1.0:1787764755.106555:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787764755.106562:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8e92be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+8:5789:x1874607176942464:12345-0@lo:501: 00000100:00100000:1.0:1787764755.106724:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8e92be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+9:5789:x1874607176942464:12345-0@lo:501: Request processed in 163us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764755.106731:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787764755.106748:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000194e12e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5789:1874607176942464:0@lo:501: 00000100:00100000:3.0:1787764755.106777:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000194e12e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5789:1874607176942592:0@lo:503: 00000100:00100000:3.0:1787764755.106813:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764755.106830:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a08fc31c going to sleep for 11 seconds 00000100:00100000:2.0:1787764755.106851:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176942592 00000100:00100000:2.0:1787764755.106856:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176942592 00000100:00100000:2.0:1787764755.106878:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787764755.106882:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067c4a612 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+9:5789:x1874607176942592:12345-0@lo:503: 00000100:00100000:2.0:1787764755.106998:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067c4a612 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+9:5789:x1874607176942592:12345-0@lo:503: Request processed in 114us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764755.107010:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787764755.107019:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000194e12e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5789:1874607176942592:0@lo:503: 00000100:00100000:1.0:1787764755.107361:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f7b1f25c pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5831:1874607176942720:0@lo:502: 00000100:00100000:1.0:1787764755.107405:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764755.107433:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 0000000086c3b7b8 going to sleep for 11 seconds 00000100:00100000:2.0:1787764755.107459:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176942720 00000100:00100000:2.0:1787764755.107464:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176942720 00000100:00100000:2.0:1787764755.107490:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787764755.107497:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017503239 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+9:5831:x1874607176942720:12345-0@lo:502: 00000100:00100000:2.0:1787764755.107638:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017503239 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+9:5831:x1874607176942720:12345-0@lo:502: Request processed in 142us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764755.107646:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787764755.107683:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f7b1f25c pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5831:1874607176942720:0@lo:502: 00000020:01000000:1.0:1787764755.107708:0:5831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787764755.107718:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787764755.107720:0:5831:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787764755.107725:0:5831:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787764755.107728:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787764755.107744:0:5831:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000bbeeadd1) 00000020:00000080:1.0:1787764755.107758:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787764755.107764:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787764755.107866:0:5831:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787764755.107872:0:5831:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdf82b4f42fb3792b 00000020:00000080:1.0:1787764755.108065:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787764755.108068:0:5831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787764755.108070:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787764755.108071:0:5831:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787764755.108073:0:5831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787764755.108075:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787764755.108075:0:5831:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787764755.108077:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787764755.108096:0:5831:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000a1cbe5d8) 00000020:00000080:1.0:1787764755.108103:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787764755.108105:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787764755.108107:0:5831:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787764755.108109:0:5831:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787764755.108113:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787764755.108147:0:5831:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000089990f3 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787764755.108155:0:5831:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000001e161576) 00000020:00000080:1.0:1787764755.108159:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787764755.108203:0:5831:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787764755.108211:0:5831:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdf82b4f42fb37940 00000020:00000080:1.0:1787764755.108295:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787764755.108301:0:5831:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787764755.108305:0:5831:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xdf82b4f42fb37947 00080000:01000000:1.0:1787764755.108309:0:5831:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787764755.108311:0:5831:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdf82b4f42fb3794e 00080000:10000000:1.0:1787764755.108558:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1787764755.108702:0:5831:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1787764755.110658:0:5831:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1787764755.150423:0:5831:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1787764755.150686:0:5831:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1787764755.152146:0:5831:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1787764755.152301:0:5831:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787764755.165414:0:5831:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000aa8861dc) 00000020:00000080:3.0:1787764755.165438:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787764755.165516:0:5831:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787764755.165525:0:5831:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdf82b4f42fb3795c 00000020:00000080:1.0:1787764755.165944:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1787764755.167889:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787764755.189454:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787764755.202417:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787764755.222452:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787764755.238355:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787764755.249112:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1787764755.265636:0:5831:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xdf82b4f42fb37963 00000020:00000080:3.0:1787764755.265902:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787764755.265912:0:5831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787764755.265917:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787764755.265919:0:5831:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787764755.265922:0:5831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787764755.265925:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787764755.265927:0:5831:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787764755.265929:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787764755.265931:0:5831:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787764755.265933:0:5831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787764755.265935:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787764755.265941:0:5831:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787764755.265944:0:5831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787764755.265948:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787764755.265948:0:5831:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787764755.265952:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787764755.265982:0:5831:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1787764755.266028:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000194e12e0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5831:1874607176942848:0@lo:502: 00000100:00100000:3.0:1787764755.266167:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764755.266211:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 000000003bcdd85c going to sleep for 11 seconds 00000100:00100000:2.0:1787764755.266217:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176942848 00000100:00100000:2.0:1787764755.266225:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176942848 00000100:00100000:2.0:1787764755.266268:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787764755.266278:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043725484 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+9:5831:x1874607176942848:12345-0@lo:502: 00000100:00100000:2.0:1787764755.266579:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043725484 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+9:5831:x1874607176942848:12345-0@lo:502: Request processed in 303us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764755.266588:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787764755.266613:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000194e12e0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5831:1874607176942848:0@lo:502: 00000020:01000000:3.0:1787764755.266639:0:5831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787764755.266643:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787764755.266644:0:5831:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1787764755.266647:0:5831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1787764755.266739:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1787764755.266767:0:5789:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787764755.266783:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: 00000000df34ab74/0xdf82b4f42fb37916 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb3791d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764755.266794:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: 00000000df34ab74/0xdf82b4f42fb37916 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb3791d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787764755.266802:0:5789:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dfce623b000 from 1 10000000:01000000:0.0:1787764755.266805:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787764755.266828:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: 00000000e0139c66/0xdf82b4f42fb3796a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764755.266835:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: 00000000e0139c66/0xdf82b4f42fb3796a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764755.266842:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: 00000000e0139c66/0xdf82b4f42fb3796a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764755.266853:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cb8ab1b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5789:1874607176942976:0@lo:101: 00000100:00100000:0.0:1787764755.266881:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764755.266901:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f51eaadf going to sleep for 11 seconds 00000100:00100000:2.0:1787764755.266935:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176942976 00000100:00100000:2.0:1787764755.266941:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176942976 00000100:00100000:2.0:1787764755.266965:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787764755.266972:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d3c95bdf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+9:5789:x1874607176942976:12345-0@lo:101: 00010000:00010000:2.0:1787764755.266981:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764755.266992:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b3442835/0xdf82b4f42fb37971 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb3796a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764755.267013:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b3442835/0xdf82b4f42fb37971 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb3796a expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764755.267032:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b3442835/0xdf82b4f42fb37971 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb3796a expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764755.267046:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b3442835, rc 0) 00000100:00100000:0.0:1787764755.267113:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cb8ab1b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5789:1874607176942976:0@lo:101: 00000100:00100000:2.0:1787764755.267119:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d3c95bdf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+10:5789:x1874607176942976:12345-0@lo:101: Request processed in 110us (200us total) trans 0 rc 0/0 00010000:00010000:0.0:1787764755.267126:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: 00000000e0139c66/0xdf82b4f42fb3796a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37971 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764755.267129:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1787764755.267140:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: 00000000e0139c66/0xdf82b4f42fb3796a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf82b4f42fb37971 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764755.267747:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cb8ab1b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5789:1874607176943104:0@lo:256: 00000100:00100000:0.0:1787764755.267771:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764755.267789:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f51eaadf going to sleep for 11 seconds 00000100:00100000:2.0:1787764755.267805:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176943104 00000100:00100000:2.0:1787764755.267809:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176943104 00000100:00100000:2.0:1787764755.267829:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787764755.267833:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002491a4f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+10:5789:x1874607176943104:12345-0@lo:256: 20000000:01000000:2.0:1787764755.267843:0:5804:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787764755.267847:0:5804:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787764755.267898:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002491a4f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+10:5789:x1874607176943104:12345-0@lo:256: Request processed in 64us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764755.267905:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787764755.267910:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cb8ab1b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5789:1874607176943104:0@lo:256: 10000000:01000000:0.0:1787764755.268651:0:5789:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787764755.268661:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: 00000000e0139c66/0xdf82b4f42fb3796a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37971 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764755.268678:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: 00000000e0139c66/0xdf82b4f42fb3796a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37971 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787764755.268686:0:5789:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dfce623b000 from 1 10000000:01000000:0.0:1787764755.268688:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787764755.268703:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: 0000000033c5ad14/0xdf82b4f42fb37978 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764755.268709:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: 0000000033c5ad14/0xdf82b4f42fb37978 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764755.268716:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: 0000000033c5ad14/0xdf82b4f42fb37978 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764755.268736:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cb8ab1b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5789:1874607176943232:0@lo:101: 00000100:00100000:0.0:1787764755.268756:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764755.268775:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f51eaadf going to sleep for 11 seconds 00000100:00100000:2.0:1787764755.268789:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176943232 00000100:00100000:2.0:1787764755.268793:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176943232 00000100:00100000:2.0:1787764755.268819:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787764755.268823:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d088e975 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+10:5789:x1874607176943232:12345-0@lo:101: 00010000:00010000:2.0:1787764755.268829:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764755.268838:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006f34d4a1/0xdf82b4f42fb3797f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb37978 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764755.268851:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006f34d4a1/0xdf82b4f42fb3797f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb37978 expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764755.268858:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006f34d4a1/0xdf82b4f42fb3797f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37978 expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764755.268876:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006f34d4a1, rc 0) 00000100:00100000:2.0:1787764755.268903:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d088e975 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+11:5789:x1874607176943232:12345-0@lo:101: Request processed in 79us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764755.268915:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787764755.268919:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cb8ab1b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5789:1874607176943232:0@lo:101: 00010000:00010000:0.0:1787764755.268930:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: 0000000033c5ad14/0xdf82b4f42fb37978 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb3797f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764755.268935:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: 0000000033c5ad14/0xdf82b4f42fb37978 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf82b4f42fb3797f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764755.268971:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cb8ab1b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5789:1874607176943360:0@lo:501: 00000100:00100000:0.0:1787764755.268994:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764755.269010:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f51eaadf going to sleep for 11 seconds 00000100:00100000:2.0:1787764755.269040:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176943360 00000100:00100000:2.0:1787764755.269044:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176943360 00000100:00100000:2.0:1787764755.269064:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787764755.269071:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f077e0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+11:5789:x1874607176943360:12345-0@lo:501: 00000100:00100000:2.0:1787764755.269489:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f077e0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+11:5789:x1874607176943360:12345-0@lo:501: Request processed in 419us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764755.269496:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787764755.269532:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cb8ab1b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5789:1874607176943360:0@lo:501: 00000100:00100000:0.0:1787764755.269559:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cb8ab1b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5789:1874607176943488:0@lo:503: 00000100:00100000:0.0:1787764755.269592:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764755.269617:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f51eaadf going to sleep for 11 seconds 00000100:00100000:2.0:1787764755.269639:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176943488 00000100:00100000:2.0:1787764755.269643:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176943488 00000100:00100000:2.0:1787764755.269661:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787764755.269678:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6ad6b81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+11:5789:x1874607176943488:12345-0@lo:503: 00000040:00080000:2.0:1787764755.269701:0:5803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787764755.269736:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6ad6b81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+11:5789:x1874607176943488:12345-0@lo:503: Request processed in 60us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764755.269741:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787764755.269753:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cb8ab1b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5789:1874607176943488:0@lo:503: 00000040:00080000:0.0:1787764755.270472:0:5835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1787764755.270533:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1787764755.270550:0:5789:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787764755.270562:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: 0000000033c5ad14/0xdf82b4f42fb37978 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb3797f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764755.270569:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: 0000000033c5ad14/0xdf82b4f42fb37978 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb3797f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787764755.270605:0:5789:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787764755.270608:0:5789:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dfce623b000 10000000:01000000:3.0:1787764755.270610:0:5789:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dfce623b000 10000000:01000000:3.0:1787764755.270613:0:5789:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787764755.270616:0:5789:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dfce623b000 from 1 10000000:01000000:3.0:1787764755.270617:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787764755.270629:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: 00000000a0f64e14/0xdf82b4f42fb37986 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764755.270641:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: 00000000a0f64e14/0xdf82b4f42fb37986 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764755.270646:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: 00000000a0f64e14/0xdf82b4f42fb37986 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764755.270653:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000194e12e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5789:1874607176943616:0@lo:101: 00000100:00100000:3.0:1787764755.270687:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764755.270708:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fae0beb5 going to sleep for 11 seconds 00000100:00100000:2.0:1787764755.270717:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176943616 00000100:00100000:2.0:1787764755.270722:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176943616 00000100:00100000:2.0:1787764755.270747:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787764755.270754:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a7cdbd3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+11:5789:x1874607176943616:12345-0@lo:101: 00010000:00010000:2.0:1787764755.270762:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764755.270771:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f616f153/0xdf82b4f42fb3798d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb37986 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764755.270794:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f616f153/0xdf82b4f42fb3798d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb37986 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764755.270801:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f616f153/0xdf82b4f42fb3798d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37986 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764755.270807:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f616f153, rc 0) 00000100:00100000:2.0:1787764755.270841:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a7cdbd3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:5789:x1874607176943616:12345-0@lo:101: Request processed in 88us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764755.270848:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787764755.270878:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000194e12e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5789:1874607176943616:0@lo:101: 00010000:00010000:3.0:1787764755.270890:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: 00000000a0f64e14/0xdf82b4f42fb37986 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb3798d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764755.270898:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: 00000000a0f64e14/0xdf82b4f42fb37986 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf82b4f42fb3798d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764755.270934:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000194e12e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5789:1874607176943744:0@lo:501: 00000100:00100000:3.0:1787764755.270955:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764755.270974:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fae0beb5 going to sleep for 11 seconds 00000100:00100000:2.0:1787764755.271009:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176943744 00000100:00100000:2.0:1787764755.271012:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176943744 00000100:00100000:2.0:1787764755.271033:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787764755.271039:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d0e4499 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:5789:x1874607176943744:12345-0@lo:501: 00000100:00100000:2.0:1787764755.271307:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d0e4499 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:5789:x1874607176943744:12345-0@lo:501: Request processed in 269us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764755.271316:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787764755.271345:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000194e12e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5789:1874607176943744:0@lo:501: 00000100:00100000:3.0:1787764755.271379:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000194e12e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5789:1874607176943872:0@lo:503: 00000100:00100000:3.0:1787764755.271413:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764755.271436:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fae0beb5 going to sleep for 11 seconds 00000100:00100000:2.0:1787764755.271446:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176943872 00000100:00100000:2.0:1787764755.271450:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176943872 00000100:00100000:2.0:1787764755.271473:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787764755.271479:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005db251e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:5789:x1874607176943872:12345-0@lo:503: 00000100:00100000:2.0:1787764755.271716:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005db251e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:5789:x1874607176943872:12345-0@lo:503: Request processed in 238us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764755.271721:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787764755.271744:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000194e12e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5789:1874607176943872:0@lo:503: 00000100:00100000:0.0:1787764755.271940:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cb8ab1b5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5836:1874607176944000:0@lo:502: 00000100:00100000:0.0:1787764755.271975:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764755.271994:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aaa3890e going to sleep for 11 seconds 00000100:00100000:2.0:1787764755.272005:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176944000 00000100:00100000:2.0:1787764755.272010:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176944000 00000100:00100000:2.0:1787764755.272031:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787764755.272044:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e493cbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:5836:x1874607176944000:12345-0@lo:502: 00000100:00100000:2.0:1787764755.272302:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e493cbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:5836:x1874607176944000:12345-0@lo:502: Request processed in 260us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764755.272307:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787764755.272332:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cb8ab1b5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5836:1874607176944000:0@lo:502: 00000020:01000004:0.0:1787764755.272373:0:5836:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787764755.272390:0:5836:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000074a482b5) 00000020:00000080:0.0:1787764755.272405:0:5836:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1787764755.272466:0:5836:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000089990f3 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787764755.272469:0:5836:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000089990f3 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787764755.272471:0:5836:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000089990f3 4 00010000:00080000:0.0:1787764755.272489:0:5836:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002443461f@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.153@tcp at head 00010000:00010000:0.0:1787764755.273914:0:5836:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1787764755.274076:0:5836:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787764755.274183:0:5836:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787764755.274193:0:5836:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xdf82b4f42fb3799b 00000100:00080000:0.0:1787764755.274201:0:5836:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787764755.274205:0:5836:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000002443461f using connection 192.168.202.153@tcp/0@lo 00000100:00100000:0.0:1787764755.274230:0:5836:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cb8ab1b5 x1874607176944128/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787764755.274258:0:5836:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787764755.274290:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cb8ab1b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1874607176944128:0@lo:38: 00000100:00100000:2.0:1787764755.274345:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764755.274386:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176944128 00000100:00100000:0.0:1787764755.274393:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176944128 00000100:00100000:0.0:1787764755.274421:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787764755.274425:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044fc3bcc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1874607176944128:12345-0@lo:38: 00000100:00100000:0.0:1787764755.274472:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044fc3bcc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1874607176944128:12345-0@lo:38: Request processed in 45us (126us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787764755.274478:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787764755.274490:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787764755.274498:0:3285:0:(import.c:65:import_set_state_nolock()) 000000002443461f lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787764755.274503:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787764755.274508:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cb8ab1b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1874607176944128:0@lo:38: 00000100:00100000:1.0:1787764755.274556:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f7b1f25c pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5836:1874607176944256:0@lo:502: 00000100:00100000:1.0:1787764755.274592:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764755.274607:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set 00000000df04d6c9 going to sleep for 11 seconds 00000100:00100000:2.0:1787764755.274622:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176944256 00000100:00100000:2.0:1787764755.274626:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176944256 00000100:00100000:2.0:1787764755.274656:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787764755.274679:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb4cbbcc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:5836:x1874607176944256:12345-0@lo:502: 00000100:00100000:2.0:1787764755.274858:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb4cbbcc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:5836:x1874607176944256:12345-0@lo:502: Request processed in 196us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764755.274863:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787764755.274881:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f7b1f25c pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5836:1874607176944256:0@lo:502: 00000040:00080000:1.0:1787764755.274902:0:5836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1787764755.274970:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1787764755.275000:0:5789:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787764755.275017:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: 00000000a0f64e14/0xdf82b4f42fb37986 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb3798d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764755.275027:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: 00000000a0f64e14/0xdf82b4f42fb37986 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb3798d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787764755.275163:0:5789:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787764755.275166:0:5789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787764755.275167:0:5789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787764755.275168:0:5789:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787764755.275170:0:5789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787764755.275172:0:5789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787764755.275173:0:5789:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787764755.275174:0:5789:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787764755.275176:0:5789:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787764755.275178:0:5789:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787764755.275179:0:5789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787764755.275181:0:5789:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787764755.275184:0:5789:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1787764755.275187:0:5789:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787764755.275189:0:5789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787764755.275190:0:5789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787764755.275191:0:5789:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787764755.275192:0:5789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787764755.275193:0:5789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787764755.275194:0:5789:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787764755.275195:0:5789:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787764755.275196:0:5789:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787764755.275197:0:5789:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787764755.275198:0:5789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787764755.275199:0:5789:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787764755.275212:0:5789:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787764755.275220:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c1cf42b1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5789:1874607176944384:0@lo:253: 00000100:00100000:0.0:1787764755.275259:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764755.275285:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f003983f going to sleep for 11 seconds 00000100:00100000:2.0:1787764755.275304:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176944384 00000100:00100000:2.0:1787764755.275308:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176944384 00000100:00100000:2.0:1787764755.275339:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787764755.275359:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000400d5cf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:5789:x1874607176944384:12345-0@lo:253: 20000000:01000000:2.0:1787764755.275374:0:5803:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787764755.275386:0:5803:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787764755.287652:0:5803:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787764755.287676:0:5803:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1787764755.287693:0:5824:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787764755.287706:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787764755.287724:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000091a0f8/0xdf82b4f42fb379a2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764755.287741:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b3442835/0xdf82b4f42fb37971 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb3796a expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764755.287750:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000000091a0f8/0xdf82b4f42fb379a2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764755.287800:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b3442835/0xdf82b4f42fb37971 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf82b4f42fb3796a expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764755.287815:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b3442835/0xdf82b4f42fb37971 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf82b4f42fb3796a expref: 12 pid: 5803 timeout: 244 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764755.287830:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000194e12e0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5824:1874607176944512:0@lo:104: 00000100:00100000:3.0:1787764755.287893:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764755.287950:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000df726bab going to sleep for 11 seconds 00000100:00100000:2.0:1787764755.287967:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176944512 00000100:00100000:2.0:1787764755.287974:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176944512 00000100:00100000:2.0:1787764755.288029:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787764755.288038:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052acb5ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+3:5824:x1874607176944512:12345-0@lo:104: 00010000:00010000:2.0:1787764755.288048:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: 00000000e0139c66/0xdf82b4f42fb3796a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37971 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764755.288140:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787764755.288146:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052acb5ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+3:5824:x1874607176944512:12345-0@lo:104: Request processed in 110us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764755.288153:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787764755.288162:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787764755.288170:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: 00000000e0139c66/0xdf82b4f42fb3796a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37971 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764755.288176:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000194e12e0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5824:1874607176944512:0@lo:104: 00010000:00010000:0.0:1787764755.288181:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e0139c66 already unused, calling callback (0000000021648100) 10000000:00010000:0.0:1787764755.288185:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: 00000000e0139c66/0xdf82b4f42fb3796a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf82b4f42fb37971 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764755.288194:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000000091a0f8/0xdf82b4f42fb379a2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764755.288200:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: 00000000e0139c66/0xdf82b4f42fb3796a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf82b4f42fb37971 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787764755.288210:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: 00000000e0139c66/0xdf82b4f42fb3796a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf82b4f42fb37971 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787764755.288215:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787764755.288254:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: 00000000e0139c66/0xdf82b4f42fb3796a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37971 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764755.288259:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787764755.288279:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: 00000000e0139c66/0xdf82b4f42fb3796a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37971 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764755.288285:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: 00000000e0139c66/0xdf82b4f42fb3796a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37971 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764755.288301:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764755.288302:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764755.288304:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764755.288390:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000929824ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3287:1874607176944640:0@lo:103: 00000100:00100000:2.0:1787764755.288416:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764755.288471:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176944640 00000100:00100000:1.0:1787764755.288476:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176944640 00010000:00010000:1.0:1787764755.288497:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b3442835/0xdf82b4f42fb37971 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb3796a expref: 13 pid: 5803 timeout: 244 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764755.288529:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787764755.288545:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b21214a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+13:3287:x1874607176944640:12345-0@lo:103: 00010000:00010000:1.0:1787764755.288556:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787764755.288560:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b3442835/0xdf82b4f42fb37971 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb3796a expref: 13 pid: 5803 timeout: 244 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764755.288571:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b3442835/0xdf82b4f42fb37971 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf82b4f42fb3796a expref: 13 pid: 5803 timeout: 244 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764755.288584:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b3442835/0xdf82b4f42fb37971 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf82b4f42fb3796a expref: 13 pid: 5803 timeout: 244 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764755.288595:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000000091a0f8/0xdf82b4f42fb379a2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764755.288602:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000091a0f8/0xdf82b4f42fb379a2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787764755.288613:0:5793:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000908633s 00010000:00010000:1.0:1787764755.288617:0:5793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000091a0f8/0xdf82b4f42fb379a2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764755.288624:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000091a0f8/0xdf82b4f42fb379a2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764755.288630:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000091a0f8/0xdf82b4f42fb379a2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764755.288636:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000091a0f8/0xdf82b4f42fb379a2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764755.288641:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000091a0f8 already unused, calling callback (00000000ae94d9b2) 00010000:00010000:1.0:1787764755.288649:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000091a0f8/0xdf82b4f42fb379a2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764755.288656:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000091a0f8/0xdf82b4f42fb379a2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764755.288693:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000091a0f8/0xdf82b4f42fb379a2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764755.288705:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787764755.288715:0:5824:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000000091a0f8/0xdf82b4f42fb379a2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764755.288725:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000091a0f8/0xdf82b4f42fb379a2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764755.288729:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000091a0f8/0xdf82b4f42fb379a2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764755.288746:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b21214a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:3287:x1874607176944640:12345-0@lo:103: Request processed in 203us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764755.288755:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787764755.288755:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000929824ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3287:1874607176944640:0@lo:103: 00000100:00100000:2.0:1787764755.291045:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000400d5cf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+11:5789:x1874607176944384:12345-0@lo:253: Request processed in 15684us (15782us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764755.291054:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787764755.291067:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c1cf42b1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5789:1874607176944384:0@lo:253: 10000000:01000000:0.0:1787764755.291186:0:5789:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787764755.291190:0:5789:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787764755.291192:0:5789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787764755.291193:0:5789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787764755.291194:0:5789:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787764755.291195:0:5789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787764755.291196:0:5789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787764755.291198:0:5789:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787764755.291199:0:5789:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787764755.291200:0:5789:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787764755.291210:0:5789:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787764755.291211:0:5789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787764755.291213:0:5789:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787764755.291224:0:5789:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787764755.294059:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1787764755.294489:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787764755.294710:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1787764755.294843:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787764755.294961:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1787764755.295060:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1787764755.297178:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787764755.297332:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787764755.297472:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1787764755.297594:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787764755.297767:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787764755.297892:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1787764755.316607:0:5789:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000020:00080000:2.0:1787764755.331103:0:5841:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1787764755.331110:0:5841:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1787764755.331129:0:5789:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1787764755.331441:0:5842:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787764755.334506:0:5789:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787764755.335168:0:5789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787764755.335532:0:5789:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787764755.335537:0:5789:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787764755.335610:0:5789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787764755.336410:0:5789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787764755.336839:0:5789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787764755.336857:0:5789:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1787764755.336976:0:5789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787764755.337133:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1787764755.338734:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1787764755.338976:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1787764755.339253:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1787764755.339559:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1787764755.339856:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1787764755.340220:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1787764755.340507:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1787764755.340967:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1787764755.341232:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1787764755.341458:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1787764755.341735:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1787764755.341894:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1787764755.342129:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1787764755.342342:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1787764755.342563:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1787764755.342782:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1787764755.343153:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1787764755.343290:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1787764755.343459:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1787764755.343566:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1787764755.343828:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1787764755.343921:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1787764755.344022:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1787764755.344126:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1787764755.344311:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1787764755.344590:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1787764755.344921:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1787764755.345182:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1787764755.345439:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1787764755.345576:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1787764755.345804:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1787764755.345999:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1787764755.346335:0:5789:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1787764755.353476:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1787764755.380371:0:5789:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787764755.380432:0:5789:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb4a341c67988 00100000:10000000:0.0:1787764755.380442:0:5789:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787764755.380836:0:5789:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787764755.380853:0:5789:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.153@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787764755.380876:0:5789:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1787764755.380893:0:5789:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1787764755.395393:0:5842:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787764755.395444:0:5842:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787764755.395448:0:5842:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1787764755.928352:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764756.951382:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787764757.030593:0:6084:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787764757.975316:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764758.999251:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787764759.411178:0:6285:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc74f5d800 20000000:00000080:3.0:1787764759.411194:0:6285:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dfcecd37000 uarg=0000000000000000 20000000:01000000:3.0:1787764759.411232:0:6285:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787764759.411238:0:6285:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787764759.411242:0:6285:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787764759.411414:0:6285:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1787764759.411425:0:6285:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1787764759.413757:0:6285:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787764759.413993:0:6285:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787764759.414047:0:6285:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1787764759.414130:0:6285:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1787764759.414148:0:6285:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787764759.414164:0:6285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ec36c894/0xdf82b4f42fb379a9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764759.414180:0:6285:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006f34d4a1/0xdf82b4f42fb3797f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37978 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764759.414188:0:6285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ec36c894/0xdf82b4f42fb379a9 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764759.414221:0:6285:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006f34d4a1/0xdf82b4f42fb3797f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf82b4f42fb37978 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764759.414234:0:6285:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006f34d4a1/0xdf82b4f42fb3797f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf82b4f42fb37978 expref: 10 pid: 5803 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764759.414246:0:6285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005ea55eeb pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6285:1874607176944768:0@lo:104: 00000100:00100000:3.0:1787764759.414308:0:6285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764759.414364:0:6285:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f94ae7e8 going to sleep for 11 seconds 00000100:00100000:1.0:1787764759.414440:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176944768 00000100:00100000:1.0:1787764759.414447:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176944768 00000100:00100000:1.0:1787764759.414492:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787764759.414499:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e4603c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+3:6285:x1874607176944768:12345-0@lo:104: 00010000:00010000:1.0:1787764759.414510:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: 0000000033c5ad14/0xdf82b4f42fb37978 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb3797f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764759.414606:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787764759.414612:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e4603c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+3:6285:x1874607176944768:12345-0@lo:104: Request processed in 114us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764759.414620:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1787764759.414640:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787764759.414647:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: 0000000033c5ad14/0xdf82b4f42fb37978 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb3797f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764759.414656:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000033c5ad14 already unused, calling callback (0000000021648100) 10000000:00010000:2.0:1787764759.414659:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: 0000000033c5ad14/0xdf82b4f42fb37978 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf82b4f42fb3797f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764759.414667:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: 0000000033c5ad14/0xdf82b4f42fb37978 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf82b4f42fb3797f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787764759.414673:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: 0000000033c5ad14/0xdf82b4f42fb37978 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf82b4f42fb3797f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787764759.414678:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787764759.414727:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: 0000000033c5ad14/0xdf82b4f42fb37978 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb3797f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764759.414734:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787764759.414754:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: 0000000033c5ad14/0xdf82b4f42fb37978 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb3797f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764759.414761:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: 0000000033c5ad14/0xdf82b4f42fb37978 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb3797f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764759.414777:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764759.414779:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764759.414781:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764759.414811:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c9ec4683 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3288:1874607176944896:0@lo:103: 00000100:00100000:0.0:1787764759.414843:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764759.414882:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176944896 00000100:00100000:2.0:1787764759.414886:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176944896 00010000:00010000:2.0:1787764759.414904:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006f34d4a1/0xdf82b4f42fb3797f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37978 expref: 11 pid: 5803 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764759.414929:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787764759.414935:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c025af22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+11:3288:x1874607176944896:12345-0@lo:103: 00000100:00100000:0.0:1787764759.414938:0:5794:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1787764759.414945:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787764759.414946:0:5794:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1787764759.414950:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006f34d4a1/0xdf82b4f42fb3797f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37978 expref: 11 pid: 5803 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764759.414964:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006f34d4a1/0xdf82b4f42fb3797f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf82b4f42fb37978 expref: 11 pid: 5803 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764759.414979:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ec36c894/0xdf82b4f42fb379a9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764759.414986:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ec36c894/0xdf82b4f42fb379a9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764759.415003:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ec36c894/0xdf82b4f42fb379a9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764759.415009:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ec36c894/0xdf82b4f42fb379a9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764759.415014:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ec36c894/0xdf82b4f42fb379a9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764759.415019:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ec36c894/0xdf82b4f42fb379a9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764759.415024:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ec36c894 already unused, calling callback (00000000ae94d9b2) 00010000:00010000:2.0:1787764759.415027:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ec36c894/0xdf82b4f42fb379a9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764759.415033:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ec36c894/0xdf82b4f42fb379a9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764759.415040:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ec36c894/0xdf82b4f42fb379a9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764759.415050:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787764759.415099:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c025af22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+11:3288:x1874607176944896:12345-0@lo:103: Request processed in 165us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764759.415106:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787764759.415139:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c9ec4683 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3288:1874607176944896:0@lo:103: 00010000:00010000:3.0:1787764759.416419:0:6285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006f34d4a1/0xdf82b4f42fb3797f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf82b4f42fb37978 expref: 10 pid: 5803 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764759.416433:0:6285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005ea55eeb pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6285:1874607176944768:0@lo:104: 00010000:00010000:3.0:1787764759.416452:0:6285:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ec36c894/0xdf82b4f42fb379a9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764759.416460:0:6285:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ec36c894/0xdf82b4f42fb379a9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764759.416465:0:6285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ec36c894/0xdf82b4f42fb379a9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764759.416470:0:6285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ec36c894/0xdf82b4f42fb379a9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764760.023206:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787764760.280172:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00100000:2.0:1787764760.280181:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c1cf42b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3289:1874607176945024:0@lo:400: 00000100:00080000:0.0:1787764760.280186:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787764760.280191:0:37:0:(import.c:65:import_set_state_nolock()) 000000002443461f lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787764760.280202:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000002443461f using connection 192.168.202.153@tcp/0@lo 00000100:00100000:0.0:1787764760.280222:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000055706417 x1874607176945152/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787764760.280257:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764760.280276:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000055706417 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1874607176945152:0@lo:38: 00000100:00100000:0.0:1787764760.280289:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176945024 00000100:00100000:0.0:1787764760.280296:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176945024 00000100:00100000:3.0:1787764760.280331:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764760.280350:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787764760.280360:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe79d4d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+10:3289:x1874607176945024:12345-0@lo:400: 00000100:00100000:0.0:1787764760.280419:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe79d4d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+10:3289:x1874607176945024:12345-0@lo:400: Request processed in 61us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764760.280427:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787764760.280446:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c1cf42b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3289:1874607176945024:0@lo:400: 00000100:00100000:0.0:1787764760.280467:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176945152 00000100:00100000:0.0:1787764760.280472:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176945152 00000100:00100000:0.0:1787764760.280499:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787764760.280504:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002062462f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3285:x1874607176945152:12345-0@lo:38: 00000100:00100000:3.0:1787764760.280518:0:5809:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00010000:00080000:0.0:1787764760.280525:0:5810:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 99 last 0 00000100:00100000:3.0:1787764760.280528:0:5809:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000020:00000080:0.0:1787764760.280570:0:5810:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xdf82b4f42fb379b0 00000004:00100000:0.0:1787764760.280640:0:5810:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787764760.280817:0:5810:0:(import.c:65:import_set_state_nolock()) 00000000224f1a7e : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787764760.280862:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002062462f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1874607176945152:12345-0@lo:38: Request processed in 357us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764760.280871:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787764760.280903:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000055706417 x1874607176945152/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787764770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787764760.280918:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787764760.280926:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787764760.280931:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787764760.280933:0:3285:0:(import.c:65:import_set_state_nolock()) 000000002443461f lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787764760.280939:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000055706417 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1874607176945152:0@lo:38: 00010000:00010000:2.0:1787764761.047254:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787764761.480884:0:6649:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787764761.480888:0:6649:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1787764761.481010:0:6649:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000c489bb63 00000020:01000004:1.0:1787764761.481025:0:6649:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787764761.481037:0:6649:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787764761.481049:0:6649:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000c40172e7) 00000020:00000080:1.0:1787764761.481062:0:6649:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787764761.491532:0:6649:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787764761.491755:0:6649:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787764761.503516:0:6649:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787764761.507014:0:6649:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787764761.507049:0:6649:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787764761.507141:0:6649:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787764761.507169:0:6649:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787764761.507488:0:6649:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787764761.507498:0:6649:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787764761.507508:0:6649:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdf82b4f42fb379be 00000020:01000004:3.0:1787764761.507515:0:6649:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1787764761.507538:0:6649:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.153@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787764761.507541:0:6649:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787764761.507546:0:6649:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787764761.507552:0:6649:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787764761.507562:0:6649:0:(genops.c:413:class_newdev()) Allocate new device OSS (000000004cb348ad) 00000020:00000080:3.0:1787764761.507572:0:6649:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1787764761.508770:0:6649:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787764761.508962:0:6649:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787764761.508969:0:6649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787764761.516746:0:6649:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787764761.516758:0:6649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787764761.517332:0:6649:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787764761.517347:0:6649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787764761.518644:0:6649:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787764761.518771:0:6649:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787764761.518776:0:6649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787764761.519187:0:6649:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787764761.519194:0:6649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787764761.531664:0:6649:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787764761.531981:0:6649:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787764761.532035:0:6649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787764761.533545:0:6649:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787764761.533555:0:6649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787764761.534808:0:6649:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787764761.534818:0:6649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787764761.537703:0:6649:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787764761.537910:0:6649:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787764761.537923:0:6649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787764761.538450:0:6649:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787764761.538457:0:6649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1787764761.570300:0:6649:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787764761.570517:0:6649:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1787764761.570523:0:6649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787764761.571466:0:6649:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787764761.571473:0:6649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1787764761.571768:0:6649:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1787764761.571791:0:6649:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1787764761.571797:0:6649:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.153@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787764761.583548:0:6649:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.153@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787764761.583585:0:6649:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.153@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1787764761.583589:0:6649:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787764761.583591:0:6649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787764761.583593:0:6649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787764761.583594:0:6649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787764761.583595:0:6649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787764761.583596:0:6649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787764761.583597:0:6649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787764761.583599:0:6649:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787764761.583600:0:6649:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787764761.583602:0:6649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787764761.583603:0:6649:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787764761.583621:0:6649:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1787764761.583624:0:6649:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787764761.583625:0:6649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787764761.583626:0:6649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787764761.583627:0:6649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787764761.583628:0:6649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787764761.583634:0:6649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787764761.583635:0:6649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787764761.583635:0:6649:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787764761.583636:0:6649:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787764761.583637:0:6649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787764761.583638:0:6649:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787764761.583663:0:6649:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787764761.583679:0:6649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007ec9284e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176945280:0@lo:253: 00000100:00100000:1.0:1787764761.583744:0:6649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764761.583809:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176945280 00000100:00100000:1.0:1787764761.583811:0:6649:0:(client.c:2715:ptlrpc_set_wait()) set 00000000154321b8 going to sleep for 11 seconds 00000100:00100000:2.0:1787764761.583816:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176945280 00000100:00100000:2.0:1787764761.583872:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787764761.583882:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006aca693e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+10:6649:x1874607176945280:12345-0@lo:253: 20000000:01000000:2.0:1787764761.583912:0:5803:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787764761.583917:0:5803:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1787764761.583921:0:5803:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1787764761.583925:0:5803:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1787764761.584657:0:5803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787764761.584865:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1787764761.584878:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1787764761.584907:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1787764761.584913:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1787764761.584941:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1787764761.584980:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1787764761.585351:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1787764761.585377:0:5803:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.153@tcp 20000000:01000000:2.0:1787764761.585379:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.153@tcp (null) (null) (null) 00000040:00080000:2.0:1787764761.585415:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1787764761.585423:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787764761.585467:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1787764761.585476:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.153@tcp (null) (null) 00000040:00080000:2.0:1787764761.585507:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1787764761.585516:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787764761.585545:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1787764761.585577:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1787764761.586171:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1787764761.586182:0:5803:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.153@tcp 20000000:01000000:2.0:1787764761.586184:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.153@tcp (null) (null) (null) 00000040:00080000:2.0:1787764761.586216:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1787764761.586224:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787764761.586253:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1787764761.586260:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.153@tcp (null) (null) 00000040:00080000:2.0:1787764761.586317:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1787764761.586326:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787764761.586356:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1787764761.586385:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1787764761.586398:0:5803:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1787764761.586401:0:5803:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1787764761.586406:0:5803:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787764761.586407:0:5803:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787764761.586409:0:5803:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787764761.586420:0:5803:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787764761.586423:0:5803:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787764761.586452:0:5803:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787764761.586454:0:5803:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787764761.587480:0:6664:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1787764761.587519:0:6664:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1787764761.587562:0:6664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1787764761.587796:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1787764761.587859:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1787764761.587904:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1787764761.587916:0:5803:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787764761.587918:0:5803:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787764761.589203:0:6665:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1787764761.589260:0:6665:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1787764761.589310:0:6665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1787764761.589504:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1787764761.589527:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1787764761.589557:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1787764761.589566:0:5803:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787764761.589567:0:5803:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787764761.589887:0:6666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1787764761.590026:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1787764761.590056:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1787764761.590234:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:1.0:1787764761.590253:0:5803:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787764761.590270:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004cf305e4/0xdf82b4f42fb379cc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764761.590288:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002a9200cf/0xdf82b4f42fb37901 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb378fa expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764761.590295:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000febc8868/0xdf82b4f42fb3791d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37916 expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764761.590300:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f616f153/0xdf82b4f42fb3798d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37986 expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764761.590314:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000004cf305e4/0xdf82b4f42fb379cc lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764761.590349:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f616f153/0xdf82b4f42fb3798d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf82b4f42fb37986 expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764761.590363:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f616f153/0xdf82b4f42fb3798d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf82b4f42fb37986 expref: 10 pid: 5804 timeout: 250 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764761.590376:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a242b07 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5803:1874607176945408:0@lo:104: 00000100:00100000:1.0:1787764761.590455:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787764761.590518:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000febc8868/0xdf82b4f42fb3791d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf82b4f42fb37916 expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764761.590522:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176945408 00010000:00010000:1.0:1787764761.590528:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000febc8868/0xdf82b4f42fb3791d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf82b4f42fb37916 expref: 10 pid: 5804 timeout: 250 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764761.590530:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176945408 00000100:00100000:1.0:1787764761.590540:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000dc1a1bd pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5803:1874607176945536:0@lo:104: 00000100:00100000:1.0:1787764761.590566:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764761.590578:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176945536 00000100:00100000:2.0:1787764761.590582:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176945536 00010000:00010000:1.0:1787764761.590588:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002a9200cf/0xdf82b4f42fb37901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf82b4f42fb378fa expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764761.590598:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002a9200cf/0xdf82b4f42fb37901 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf82b4f42fb378fa expref: 10 pid: 5803 timeout: 250 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764761.590602:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787764761.590628:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000096518acf pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5803:1874607176945664:0@lo:104: 00000100:00100000:2.0:1787764761.590632:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000168665b4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+4:5803:x1874607176945408:12345-0@lo:104: 00000100:00100000:3.0:1787764761.590633:0:5792:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1787764761.590645:0:5792:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1787764761.590649:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: 00000000a0f64e14/0xdf82b4f42fb37986 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb3798d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764761.590662:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764761.590673:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set 000000005d17a6d6 going to sleep for 11 seconds 00010000:00010000:2.0:1787764761.590711:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787764761.590722:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000168665b4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+4:5803:x1874607176945408:12345-0@lo:104: Request processed in 94us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764761.590729:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787764761.590734:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a242b07 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5803:1874607176945408:0@lo:104: 00000100:00100000:2.0:1787764761.590746:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176945664 00000100:00100000:2.0:1787764761.590751:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176945664 00000100:00100000:2.0:1787764761.590766:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787764761.590770:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027311d89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+4:5803:x1874607176945536:12345-0@lo:104: 00010000:00010000:2.0:1787764761.590777:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: 00000000df34ab74/0xdf82b4f42fb37916 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb3791d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764761.590800:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787764761.590806:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: 00000000a0f64e14/0xdf82b4f42fb37986 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb3798d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764761.590815:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a0f64e14 already unused, calling callback (0000000021648100) 10000000:00010000:0.0:1787764761.590819:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: 00000000a0f64e14/0xdf82b4f42fb37986 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf82b4f42fb3798d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764761.590819:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787764761.590828:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027311d89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+4:5803:x1874607176945536:12345-0@lo:104: Request processed in 56us (261us total) trans 0 rc 0/0 00010000:00010000:0.0:1787764761.590832:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: 00000000a0f64e14/0xdf82b4f42fb37986 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf82b4f42fb3798d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764761.590840:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787764761.590840:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:0.0:1787764761.590843:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: 00000000a0f64e14/0xdf82b4f42fb37986 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf82b4f42fb3798d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787764761.590855:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787764761.590855:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000dc1a1bd pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5803:1874607176945536:0@lo:104: 00000100:00100000:2.0:1787764761.590861:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787764761.590872:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6615d2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+3:5803:x1874607176945664:12345-0@lo:104: 00010000:00010000:2.0:1787764761.590879:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: 0000000019b7d34e/0xdf82b4f42fb378fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37901 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764761.590890:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: 00000000a0f64e14/0xdf82b4f42fb37986 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb3798d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764761.590898:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787764761.590917:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1787764761.590923:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: 00000000a0f64e14/0xdf82b4f42fb37986 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb3798d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764761.590923:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6615d2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+3:5803:x1874607176945664:12345-0@lo:104: Request processed in 53us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764761.590936:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000096518acf pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5803:1874607176945664:0@lo:104: 00010000:00010000:0.0:1787764761.590938:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: 00000000a0f64e14/0xdf82b4f42fb37986 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb3798d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764761.590938:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787764761.590939:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a7ab1ff5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3286:1874607176945792:0@lo:103: 00010000:00010000:0.0:1787764761.590959:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787764761.590962:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: 0000000019b7d34e/0xdf82b4f42fb378fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37901 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764761.590968:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000019b7d34e already unused, calling callback (0000000021648100) 10000000:00010000:0.0:1787764761.590971:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: 0000000019b7d34e/0xdf82b4f42fb378fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf82b4f42fb37901 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764761.590975:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000004cf305e4/0xdf82b4f42fb379cc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764761.590985:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787764761.590997:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: 0000000019b7d34e/0xdf82b4f42fb378fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf82b4f42fb37901 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787764761.591002:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: 0000000019b7d34e/0xdf82b4f42fb378fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf82b4f42fb37901 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787764761.591007:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787764761.591024:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: 0000000019b7d34e/0xdf82b4f42fb378fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37901 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764761.591030:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787764761.591038:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: 0000000019b7d34e/0xdf82b4f42fb378fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37901 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764761.591052:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1787764761.591055:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: 0000000019b7d34e/0xdf82b4f42fb378fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37901 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764761.591061:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000382bf16 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3286:1874607176945920:0@lo:103: 00010000:00010000:0.0:1787764761.591068:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764761.591071:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764761.591073:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764761.591122:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764761.591154:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176945792 00000100:00100000:2.0:1787764761.591159:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176945792 00010000:00010000:2.0:1787764761.591189:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f616f153/0xdf82b4f42fb3798d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37986 expref: 11 pid: 5804 timeout: 250 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764761.591215:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176945920 00000100:00100000:2.0:1787764761.591225:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176945920 00010000:00010000:2.0:1787764761.591239:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002a9200cf/0xdf82b4f42fb37901 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb378fa expref: 12 pid: 5803 timeout: 250 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764761.591254:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787764761.591265:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005492f702 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:3286:x1874607176945792:12345-0@lo:103: 00000100:00100000:2.0:1787764761.591271:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787764761.591280:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ea55eeb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:3286:x1874607176945920:12345-0@lo:103: 00010000:00010000:3.0:1787764761.591281:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787764761.591294:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f616f153/0xdf82b4f42fb3798d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37986 expref: 12 pid: 5804 timeout: 250 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764761.591296:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787764761.591304:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002a9200cf/0xdf82b4f42fb37901 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb378fa expref: 12 pid: 5803 timeout: 250 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764761.591323:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f616f153/0xdf82b4f42fb3798d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf82b4f42fb37986 expref: 12 pid: 5804 timeout: 250 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764761.591333:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764761.591336:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002a9200cf/0xdf82b4f42fb37901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf82b4f42fb378fa expref: 12 pid: 5803 timeout: 250 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764761.591337:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764761.591341:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764761.591342:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: 00000000df34ab74/0xdf82b4f42fb37916 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb3791d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764761.591354:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000df34ab74 already unused, calling callback (0000000021648100) 00010000:00010000:3.0:1787764761.591356:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f616f153/0xdf82b4f42fb3798d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf82b4f42fb37986 expref: 12 pid: 5804 timeout: 250 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787764761.591358:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: 00000000df34ab74/0xdf82b4f42fb37916 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf82b4f42fb3791d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764761.591361:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002a9200cf/0xdf82b4f42fb37901 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf82b4f42fb378fa expref: 12 pid: 5803 timeout: 250 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764761.591382:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: 00000000df34ab74/0xdf82b4f42fb37916 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf82b4f42fb3791d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764761.591383:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787764761.591389:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:00010000:1.0:1787764761.591390:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: 00000000df34ab74/0xdf82b4f42fb37916 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf82b4f42fb3791d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787764761.591395:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787764761.591416:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: 00000000df34ab74/0xdf82b4f42fb37916 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb3791d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764761.591420:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005492f702 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+10:3286:x1874607176945792:12345-0@lo:103: Request processed in 157us (438us total) trans 0 rc 0/0 00010000:00010000:1.0:1787764761.591429:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787764761.591433:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787764761.591441:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ea55eeb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+10:3286:x1874607176945920:12345-0@lo:103: Request processed in 163us (319us total) trans 0 rc 0/0 00010000:00010000:1.0:1787764761.591445:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: 00000000df34ab74/0xdf82b4f42fb37916 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb3791d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764761.591451:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787764761.591453:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: 00000000df34ab74/0xdf82b4f42fb37916 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb3791d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764761.591470:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000382bf16 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3286:1874607176945920:0@lo:103: 00010000:00010000:1.0:1787764761.591471:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764761.591478:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764761.591482:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787764761.591493:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000096518acf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3288:1874607176946048:0@lo:103: 00000100:00100000:3.0:1787764761.591494:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a7ab1ff5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3286:1874607176945792:0@lo:103: 00000100:00100000:1.0:1787764761.591521:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764761.591560:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176946048 00000100:00100000:0.0:1787764761.591566:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176946048 00010000:00010000:0.0:1787764761.591589:0:6286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000febc8868/0xdf82b4f42fb3791d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37916 expref: 9 pid: 5804 timeout: 250 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764761.591623:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787764761.591630:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000dc1a1bd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+9:3288:x1874607176946048:12345-0@lo:103: 00010000:00010000:0.0:1787764761.591644:0:6286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787764761.591647:0:6286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000febc8868/0xdf82b4f42fb3791d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37916 expref: 9 pid: 5804 timeout: 250 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764761.591656:0:6286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000febc8868/0xdf82b4f42fb3791d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf82b4f42fb37916 expref: 9 pid: 5804 timeout: 250 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764761.591675:0:6286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000febc8868/0xdf82b4f42fb3791d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf82b4f42fb37916 expref: 9 pid: 5804 timeout: 250 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764761.591686:0:6286:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000004cf305e4/0xdf82b4f42fb379cc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764761.591694:0:6286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004cf305e4/0xdf82b4f42fb379cc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764761.591704:0:6286:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004cf305e4/0xdf82b4f42fb379cc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764761.591710:0:6286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004cf305e4/0xdf82b4f42fb379cc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764761.591715:0:6286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004cf305e4/0xdf82b4f42fb379cc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764761.591720:0:6286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004cf305e4/0xdf82b4f42fb379cc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764761.591724:0:6286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004cf305e4 already unused, calling callback (00000000ae94d9b2) 00010000:00010000:0.0:1787764761.591728:0:6286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004cf305e4/0xdf82b4f42fb379cc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764761.591742:0:6286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004cf305e4/0xdf82b4f42fb379cc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764761.591759:0:6286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004cf305e4/0xdf82b4f42fb379cc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764761.591768:0:6286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787764761.591807:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000dc1a1bd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+8:3288:x1874607176946048:12345-0@lo:103: Request processed in 179us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764761.591814:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1787764761.591857:0:5803:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000004cf305e4/0xdf82b4f42fb379cc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764761.591866:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004cf305e4/0xdf82b4f42fb379cc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764761.591879:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004cf305e4/0xdf82b4f42fb379cc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787764761.591893:0:5803:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787764761.591907:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000096518acf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3288:1874607176946048:0@lo:103: 00000100:00100000:0.0:1787764761.618325:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006aca693e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+7:6649:x1874607176945280:12345-0@lo:253: Request processed in 34439us (34575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764761.618342:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787764761.618372:0:6649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007ec9284e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176945280:0@lo:253: 10000000:01000000:1.0:1787764761.618391:0:6649:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787764761.618394:0:6649:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787764761.618403:0:6649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787764761.618405:0:6649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787764761.618417:0:6649:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1787764761.618418:0:6649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787764761.618420:0:6649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787764761.618421:0:6649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787764761.618423:0:6649:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787764761.618424:0:6649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787764761.618426:0:6649:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787764761.618444:0:6649:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c489bb63 from lustre-OST0000 10000000:01000000:1.0:1787764761.618499:0:6649:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787764761.618502:0:6649:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787764761.618509:0:6649:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9dfcc4e21a48 local copy 10000000:01000000:1.0:1787764761.618514:0:6649:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787764761.618553:0:6649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: 000000004cf305e4/0xdf82b4f42fb379d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764761.618585:0:6649:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.153@tcp lock: 000000004cf305e4/0xdf82b4f42fb379d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764761.618595:0:6649:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: 000000004cf305e4/0xdf82b4f42fb379d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764761.618635:0:6649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007ec9284e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176946176:0@lo:101: 00000100:00100000:1.0:1787764761.618674:0:6649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764761.618716:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176946176 00000100:00100000:0.0:1787764761.618722:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176946176 00000100:00100000:1.0:1787764761.618749:0:6649:0:(client.c:2715:ptlrpc_set_wait()) set 000000002a9b8d15 going to sleep for 11 seconds 00000100:00100000:0.0:1787764761.618786:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787764761.618797:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bfabdba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+7:6649:x1874607176946176:12345-0@lo:101: 00010000:00010000:0.0:1787764761.618811:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787764761.618824:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bbabc177/0xdf82b4f42fb379da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb379d3 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764761.618844:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bbabc177/0xdf82b4f42fb379da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb379d3 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764761.618855:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bbabc177/0xdf82b4f42fb379da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb379d3 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764761.618864:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bbabc177, rc 0) 00000100:00100000:1.0:1787764761.619027:0:6649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007ec9284e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176946176:0@lo:101: 00000100:00100000:0.0:1787764761.619028:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bfabdba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+8:6649:x1874607176946176:12345-0@lo:101: Request processed in 233us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764761.619039:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1787764761.619044:0:6649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: 000000004cf305e4/0xdf82b4f42fb379d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdf82b4f42fb379da expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764761.619054:0:6649:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: 000000004cf305e4/0xdf82b4f42fb379d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdf82b4f42fb379da expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764761.619198:0:6649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007ec9284e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176946304:0@lo:501: 00000100:00100000:1.0:1787764761.619224:0:6649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764761.619245:0:6649:0:(client.c:2715:ptlrpc_set_wait()) set 000000002a9b8d15 going to sleep for 11 seconds 00000100:00100000:0.0:1787764761.619272:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176946304 00000100:00100000:0.0:1787764761.619278:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176946304 00000100:00100000:0.0:1787764761.619306:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787764761.619313:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b7e11b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+8:6649:x1874607176946304:12345-0@lo:501: 00000100:00100000:0.0:1787764761.619500:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b7e11b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+8:6649:x1874607176946304:12345-0@lo:501: Request processed in 187us (275us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787764761.619507:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787764761.619532:0:6649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007ec9284e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176946304:0@lo:501: 10000000:01000000:1.0:1787764761.619545:0:6649:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787764761.619564:0:6649:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787764761.619567:0:6649:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: 000000004cf305e4/0xdf82b4f42fb379d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdf82b4f42fb379da expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764761.619573:0:6649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: 000000004cf305e4/0xdf82b4f42fb379d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdf82b4f42fb379da expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764761.619582:0:6649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: 000000004cf305e4/0xdf82b4f42fb379d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdf82b4f42fb379da expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764761.619601:0:6649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787764761.619627:0:6649:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dfcf55aa800 10000000:01000000:1.0:1787764761.619631:0:6649:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787764761.619635:0:6649:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9dfcc4e21a48 10000000:01000000:1.0:1787764761.619636:0:6649:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787764761.619638:0:6649:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9dfcc4e21a48 from 1 10000000:01000000:1.0:1787764761.619640:0:6649:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787764761.619650:0:6649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: 00000000ea102cd3/0xdf82b4f42fb379e1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764761.619654:0:6649:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: 00000000ea102cd3/0xdf82b4f42fb379e1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764761.619659:0:6649:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: 00000000ea102cd3/0xdf82b4f42fb379e1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764761.619673:0:6649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007ec9284e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176946432:0@lo:101: 00010000:00010000:0.0:1787764761.619676:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787764761.619682:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: 000000004cf305e4/0xdf82b4f42fb379d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xdf82b4f42fb379da expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764761.619689:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004cf305e4 already unused, calling callback (0000000021648100) 10000000:00010000:0.0:1787764761.619692:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: 000000004cf305e4/0xdf82b4f42fb379d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xdf82b4f42fb379da expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764761.619697:0:6649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787764761.619705:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: 000000004cf305e4/0xdf82b4f42fb379d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xdf82b4f42fb379da expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787764761.619712:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: 000000004cf305e4/0xdf82b4f42fb379d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xdf82b4f42fb379da expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787764761.619718:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787764761.619718:0:6649:0:(client.c:2715:ptlrpc_set_wait()) set 0000000033266ea5 going to sleep for 11 seconds 00010000:00010000:0.0:1787764761.619738:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: 000000004cf305e4/0xdf82b4f42fb379d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdf82b4f42fb379da expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764761.619740:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176946432 00000100:00100000:2.0:1787764761.619746:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176946432 00010000:00010000:0.0:1787764761.619748:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787764761.619783:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1787764761.619785:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: 000000004cf305e4/0xdf82b4f42fb379d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdf82b4f42fb379da expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764761.619789:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000082a64854 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3289:1874607176946560:0@lo:103: 00000100:00100000:2.0:1787764761.619790:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025739525 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+8:6649:x1874607176946432:12345-0@lo:101: 00010000:00010000:2.0:1787764761.619802:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787764761.619803:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: 000000004cf305e4/0xdf82b4f42fb379d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdf82b4f42fb379da expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764761.619811:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b3442835/0xdf82b4f42fb379e8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb379e1 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764761.619819:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764761.619823:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764761.619824:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764761.619827:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b3442835/0xdf82b4f42fb379e8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb379e1 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764761.619837:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787764761.619850:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b3442835/0xdf82b4f42fb379e8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb379e1 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764761.619856:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b3442835, rc 0) 00000100:00100000:1.0:1787764761.619871:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176946560 00000100:00100000:1.0:1787764761.619875:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176946560 00000100:00100000:1.0:1787764761.619903:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787764761.619903:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025739525 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+10:6649:x1874607176946432:12345-0@lo:101: Request processed in 114us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764761.619908:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a242b07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+10:3289:x1874607176946560:12345-0@lo:103: 00000100:00100000:2.0:1787764761.619909:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1787764761.619922:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787764761.619932:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bbabc177/0xdf82b4f42fb379da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdf82b4f42fb379d3 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764761.619943:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787764761.619980:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a242b07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+8:3289:x1874607176946560:12345-0@lo:103: Request processed in 72us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764761.619988:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787764761.620004:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000082a64854 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3289:1874607176946560:0@lo:103: 00000100:00100000:0.0:1787764761.620119:0:6649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007ec9284e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176946432:0@lo:101: 00010000:00010000:0.0:1787764761.620127:0:6649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: 00000000ea102cd3/0xdf82b4f42fb379e1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb379e8 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764761.620132:0:6649:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: 00000000ea102cd3/0xdf82b4f42fb379e1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf82b4f42fb379e8 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787764761.620141:0:6649:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787764761.620150:0:6649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: 00000000ea102cd3/0xdf82b4f42fb379e1 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb379e8 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764761.620154:0:6649:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: 00000000ea102cd3/0xdf82b4f42fb379e1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb379e8 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787764761.620158:0:6649:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787764761.620161:0:6649:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787764761.620163:0:6649:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787764761.620164:0:6649:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787764761.620173:0:6649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: 00000000c9e23d2b/0xdf82b4f42fb379ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764761.620177:0:6649:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: 00000000c9e23d2b/0xdf82b4f42fb379ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764761.620188:0:6649:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: 00000000c9e23d2b/0xdf82b4f42fb379ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764761.620198:0:6649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000009e1d448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176946688:0@lo:101: 00000100:00100000:0.0:1787764761.620225:0:6649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764761.620250:0:6649:0:(client.c:2715:ptlrpc_set_wait()) set 00000000332346da going to sleep for 11 seconds 00000100:00100000:2.0:1787764761.620264:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176946688 00000100:00100000:2.0:1787764761.620269:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176946688 00000100:00100000:2.0:1787764761.620293:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787764761.620298:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001917e247 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+8:6649:x1874607176946688:12345-0@lo:101: 00010000:00010000:2.0:1787764761.620304:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764761.620309:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c514c755/0xdf82b4f42fb379f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb379ef expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764761.620319:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c514c755/0xdf82b4f42fb379f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb379ef expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764761.620326:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c514c755/0xdf82b4f42fb379f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb379ef expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764761.620332:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c514c755, rc 0) 00000100:00100000:2.0:1787764761.620374:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001917e247 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+9:6649:x1874607176946688:12345-0@lo:101: Request processed in 76us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764761.620380:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787764761.620415:0:6649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000009e1d448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176946688:0@lo:101: 00010000:00010000:0.0:1787764761.620427:0:6649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: 00000000c9e23d2b/0xdf82b4f42fb379ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb379f6 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764761.620434:0:6649:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: 00000000c9e23d2b/0xdf82b4f42fb379ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf82b4f42fb379f6 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764761.620478:0:6649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000009e1d448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176946816:0@lo:501: 00000100:00100000:0.0:1787764761.620497:0:6649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764761.620513:0:6649:0:(client.c:2715:ptlrpc_set_wait()) set 00000000332346da going to sleep for 11 seconds 00000100:00100000:2.0:1787764761.620538:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176946816 00000100:00100000:2.0:1787764761.620543:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176946816 00000100:00100000:2.0:1787764761.620566:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787764761.620576:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008b388da6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+9:6649:x1874607176946816:12345-0@lo:501: 00000100:00100000:2.0:1787764761.620703:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008b388da6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+9:6649:x1874607176946816:12345-0@lo:501: Request processed in 128us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764761.620708:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787764761.620730:0:6649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000009e1d448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176946816:0@lo:501: 00000100:00100000:0.0:1787764761.620758:0:6649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000009e1d448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176946944:0@lo:503: 00000100:00100000:0.0:1787764761.620795:0:6649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764761.620813:0:6649:0:(client.c:2715:ptlrpc_set_wait()) set 00000000332346da going to sleep for 11 seconds 00000100:00100000:2.0:1787764761.620841:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176946944 00000100:00100000:2.0:1787764761.620847:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176946944 00000100:00100000:2.0:1787764761.620935:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787764761.620942:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000978c3523 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+9:6649:x1874607176946944:12345-0@lo:503: 00000100:00100000:2.0:1787764761.621116:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000978c3523 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+9:6649:x1874607176946944:12345-0@lo:503: Request processed in 174us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764761.621124:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787764761.621131:0:6649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000009e1d448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176946944:0@lo:503: 00000040:00080000:0.0:1787764761.621414:0:6649:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787764761.621475:0:6649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000009e1d448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176947072:0@lo:502: 00000100:00100000:0.0:1787764761.621519:0:6649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764761.621544:0:6649:0:(client.c:2715:ptlrpc_set_wait()) set 000000003645140c going to sleep for 11 seconds 00000100:00100000:2.0:1787764761.621578:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176947072 00000100:00100000:2.0:1787764761.621583:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176947072 00000100:00100000:2.0:1787764761.621633:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787764761.621639:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029eaf251 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+9:6649:x1874607176947072:12345-0@lo:502: 00000100:00100000:2.0:1787764761.621750:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029eaf251 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+9:6649:x1874607176947072:12345-0@lo:502: Request processed in 111us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764761.621768:0:6649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000009e1d448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176947072:0@lo:502: 00000100:00100000:2.0:1787764761.621817:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000040:00080000:0.0:1787764761.621981:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787764761.622023:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1787764761.622056:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1787764761.622132:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1787764761.622244:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1787764761.622287:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1787764761.622308:0:6649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000009e1d448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176947200:0@lo:502: 00000100:00100000:0.0:1787764761.622340:0:6649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764761.622369:0:6649:0:(client.c:2715:ptlrpc_set_wait()) set 000000003645140c going to sleep for 11 seconds 00000100:00100000:2.0:1787764761.622418:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176947200 00000100:00100000:2.0:1787764761.622422:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176947200 00000100:00100000:2.0:1787764761.622477:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787764761.622485:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7d90d9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+9:6649:x1874607176947200:12345-0@lo:502: 00000100:00100000:2.0:1787764761.622576:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7d90d9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+9:6649:x1874607176947200:12345-0@lo:502: Request processed in 94us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764761.622581:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787764761.622633:0:6649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000009e1d448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176947200:0@lo:502: 00000040:00080000:1.0:1787764761.622750:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787764761.622761:0:6649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1787764761.623421:0:6669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787764761.623429:0:6669:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1787764761.623441:0:6669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787764761.623443:0:6669:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787764761.623449:0:6669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787764761.623461:0:6669:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (00000000b1cf6403) 00000020:00000080:2.0:1787764761.623476:0:6669:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787764761.623480:0:6669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787764761.623537:0:6669:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c489bb63 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787764761.623544:0:6669:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787764761.623551:0:6669:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdf82b4f42fb37a04 00010000:00010000:2.0:1787764761.627537:0:6669:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1787764761.627944:0:6669:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1787764761.630046:0:6669:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787764761.630379:0:6669:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1787764761.634495:0:6669:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1787764761.635016:0:6669:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1787764761.635959:0:6669:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787764761.635968:0:6669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787764761.635974:0:6669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787764761.635976:0:6669:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787764761.635978:0:6669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787764761.635981:0:6669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787764761.635982:0:6669:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787764761.635985:0:6669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787764761.635986:0:6669:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787764761.636021:0:6669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787764761.636023:0:6669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787764761.636025:0:6669:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787764761.636027:0:6669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787764761.636115:0:6649:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1787764761.636144:0:6649:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787764761.636222:0:6649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: 00000000c9e23d2b/0xdf82b4f42fb379ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb379f6 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764761.636237:0:6649:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: 00000000c9e23d2b/0xdf82b4f42fb379ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb379f6 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787764761.636245:0:6649:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dfcf55aa800 from 1 10000000:01000000:1.0:1787764761.636248:0:6649:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787764761.636283:0:6649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: 0000000016887d2a/0xdf82b4f42fb37a0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764761.636291:0:6649:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: 0000000016887d2a/0xdf82b4f42fb37a0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764761.636303:0:6649:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: 0000000016887d2a/0xdf82b4f42fb37a0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764761.636347:0:6649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ffd0f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176947328:0@lo:101: 00000100:00100000:1.0:1787764761.636417:0:6649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764761.636468:0:6649:0:(client.c:2715:ptlrpc_set_wait()) set 000000009b92d12c going to sleep for 11 seconds 00000100:00100000:2.0:1787764761.637643:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176947328 00000100:00100000:2.0:1787764761.637651:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176947328 00000100:00100000:2.0:1787764761.637696:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787764761.637703:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b91a84b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+9:6649:x1874607176947328:12345-0@lo:101: 00010000:00010000:2.0:1787764761.637731:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764761.637744:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000febc8868/0xdf82b4f42fb37a12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb37a0b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764761.637768:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000febc8868/0xdf82b4f42fb37a12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb37a0b expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764761.637778:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000febc8868/0xdf82b4f42fb37a12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37a0b expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764761.637786:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000febc8868, rc 0) 00000100:00100000:2.0:1787764761.637832:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b91a84b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+10:6649:x1874607176947328:12345-0@lo:101: Request processed in 129us (1416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764761.637838:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787764761.639817:0:6649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ffd0f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176947328:0@lo:101: 00010000:00010000:3.0:1787764761.639847:0:6649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: 0000000016887d2a/0xdf82b4f42fb37a0b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37a12 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764761.639859:0:6649:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: 0000000016887d2a/0xdf82b4f42fb37a0b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf82b4f42fb37a12 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764761.639966:0:6649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f0586bbf pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176947456:0@lo:501: 00000100:00100000:3.0:1787764761.640013:0:6649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764761.640048:0:6649:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fd9a427e going to sleep for 11 seconds 00000100:00100000:2.0:1787764761.640108:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176947456 00000100:00100000:2.0:1787764761.640113:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176947456 00000100:00100000:2.0:1787764761.640158:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787764761.640167:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087367dc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+10:6649:x1874607176947456:12345-0@lo:501: 00000100:00100000:2.0:1787764761.641130:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087367dc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+10:6649:x1874607176947456:12345-0@lo:501: Request processed in 963us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764761.641140:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787764761.642000:0:6649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f0586bbf pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176947456:0@lo:501: 00000100:00100000:3.0:1787764761.642042:0:6649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f0586bbf pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176947584:0@lo:503: 00000100:00100000:3.0:1787764761.642494:0:6649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764761.642532:0:6649:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fd9a427e going to sleep for 11 seconds 00000100:00100000:0.0:1787764761.642652:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176947584 00000100:00100000:0.0:1787764761.642658:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176947584 00000100:00100000:0.0:1787764761.642701:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787764761.642710:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ca802d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+10:6649:x1874607176947584:12345-0@lo:503: 00000100:00100000:0.0:1787764761.642974:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ca802d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+10:6649:x1874607176947584:12345-0@lo:503: Request processed in 266us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764761.642982:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787764761.643512:0:6649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f0586bbf pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176947584:0@lo:503: 00000040:00080000:3.0:1787764761.643780:0:6649:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787764761.643847:0:6649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f0586bbf pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176947712:0@lo:502: 00000100:00100000:3.0:1787764761.643882:0:6649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764761.643915:0:6649:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fd9a427e going to sleep for 11 seconds 00000100:00100000:2.0:1787764761.643967:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176947712 00000100:00100000:2.0:1787764761.643972:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176947712 00000100:00100000:2.0:1787764761.644005:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787764761.644011:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000602a267 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+10:6649:x1874607176947712:12345-0@lo:502: 00000100:00100000:2.0:1787764761.644198:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000602a267 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+10:6649:x1874607176947712:12345-0@lo:502: Request processed in 187us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764761.644205:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787764761.644235:0:6649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f0586bbf pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176947712:0@lo:502: 00000040:00080000:3.0:1787764761.644464:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787764761.644495:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787764761.644508:0:6649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f0586bbf pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176947840:0@lo:502: 00000100:00100000:3.0:1787764761.644533:0:6649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764761.644551:0:6649:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fd9a427e going to sleep for 11 seconds 00000100:00100000:0.0:1787764761.644572:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176947840 00000100:00100000:0.0:1787764761.644577:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176947840 00000100:00100000:0.0:1787764761.644618:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787764761.644627:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004b07e4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+10:6649:x1874607176947840:12345-0@lo:502: 00000100:00100000:0.0:1787764761.644752:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004b07e4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+10:6649:x1874607176947840:12345-0@lo:502: Request processed in 126us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764761.644761:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787764761.644784:0:6649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f0586bbf pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176947840:0@lo:502: 00000040:00080000:3.0:1787764761.644862:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787764761.644870:0:6649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787764761.645691:0:6673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787764761.645700:0:6673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787764761.645703:0:6673:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787764761.645709:0:6673:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dfcf55aa800 00000020:00000080:0.0:1787764761.645717:0:6673:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787764761.645801:0:6673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787764761.645805:0:6673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787764761.645806:0:6673:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787764761.645809:0:6673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787764761.649332:0:6649:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787764761.649367:0:6649:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787764761.649387:0:6649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfce1d34600/0xdf82b4f42fb37a0b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37a12 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764761.649399:0:6649:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff9dfce1d34600/0xdf82b4f42fb37a0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37a12 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787764761.649442:0:6649:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787764761.649444:0:6649:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dfcf55aa800 10000000:01000000:3.0:1787764761.649447:0:6649:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dfcf55aa800 10000000:01000000:3.0:1787764761.649450:0:6649:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787764761.649455:0:6649:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dfcf55aa800 from 1 10000000:01000000:3.0:1787764761.649458:0:6649:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787764761.649490:0:6649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcdab66000/0xdf82b4f42fb37a19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764761.649497:0:6649:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff9dfcdab66000/0xdf82b4f42fb37a19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764761.649507:0:6649:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff9dfcdab66000/0xdf82b4f42fb37a19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764761.649527:0:6649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176947968:0@lo:101: 00000100:00100000:3.0:1787764761.649583:0:6649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764761.649645:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176947968 00000100:00100000:3.0:1787764761.649651:0:6649:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfced8f9840 going to sleep for 11 seconds 00000100:00100000:0.0:1787764761.649652:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176947968 00000100:00100000:0.0:1787764761.649688:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787764761.649699:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+10:6649:x1874607176947968:12345-0@lo:101: 00010000:00010000:0.0:1787764761.649712:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787764761.649725:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dfcc0030200/0xdf82b4f42fb37a20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb37a19 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764761.649758:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfcc0030200/0xdf82b4f42fb37a20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb37a19 expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764761.649769:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dfcc0030200/0xdf82b4f42fb37a20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37a19 expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764761.649778:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcc0030200, rc 0) 00000100:00100000:0.0:1787764761.649814:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+11:6649:x1874607176947968:12345-0@lo:101: Request processed in 119us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764761.649819:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787764761.649857:0:6649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176947968:0@lo:101: 00010000:00010000:3.0:1787764761.649871:0:6649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff9dfcdab66000/0xdf82b4f42fb37a19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37a20 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764761.649898:0:6649:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff9dfcdab66000/0xdf82b4f42fb37a19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf82b4f42fb37a20 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764761.649976:0:6649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176948096:0@lo:501: 00000100:00100000:3.0:1787764761.649999:0:6649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764761.650015:0:6649:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfced8f9840 going to sleep for 11 seconds 00000100:00100000:0.0:1787764761.650040:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176948096 00000100:00100000:0.0:1787764761.650045:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176948096 00000100:00100000:0.0:1787764761.650068:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787764761.650076:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+11:6649:x1874607176948096:12345-0@lo:501: 00000100:00100000:0.0:1787764761.650318:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+11:6649:x1874607176948096:12345-0@lo:501: Request processed in 242us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764761.650326:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787764761.650394:0:6649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176948096:0@lo:501: 00000100:00100000:3.0:1787764761.650482:0:6649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176948224:0@lo:503: 00000100:00100000:3.0:1787764761.650516:0:6649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764761.650540:0:6649:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfced8f9840 going to sleep for 11 seconds 00000100:00100000:0.0:1787764761.650579:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176948224 00000100:00100000:0.0:1787764761.650637:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176948224 00000100:00100000:1.0:1787764761.650728:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787764761.650738:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+11:6649:x1874607176948224:12345-0@lo:503: 00000100:00100000:1.0:1787764761.650879:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+11:6649:x1874607176948224:12345-0@lo:503: Request processed in 142us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764761.650887:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787764761.650894:0:6649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176948224:0@lo:503: 00000040:00080000:3.0:1787764761.651130:0:6649:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787764761.651183:0:6649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176948352:0@lo:502: 00000100:00100000:3.0:1787764761.651211:0:6649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764761.651229:0:6649:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfced8f9840 going to sleep for 11 seconds 00000100:00100000:0.0:1787764761.651264:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176948352 00000100:00100000:0.0:1787764761.651269:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176948352 00000100:00100000:0.0:1787764761.651297:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787764761.651305:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+11:6649:x1874607176948352:12345-0@lo:502: 00000100:00100000:0.0:1787764761.651479:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+11:6649:x1874607176948352:12345-0@lo:502: Request processed in 175us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764761.651486:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787764761.651509:0:6649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176948352:0@lo:502: 00000040:00080000:3.0:1787764761.651742:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787764761.651783:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787764761.651808:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787764761.651841:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787764761.651872:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787764761.651912:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787764761.651939:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787764761.651963:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787764761.652014:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787764761.652044:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787764761.652077:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787764761.652148:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787764761.652176:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787764761.652200:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787764761.652244:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787764761.652286:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787764761.652325:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787764761.652371:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787764761.652402:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787764761.652440:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787764761.652476:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787764761.652503:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787764761.652532:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787764761.652576:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787764761.652618:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1787764761.652651:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1787764761.652689:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1787764761.652716:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1787764761.652741:0:6649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176948480:0@lo:502: 00000100:00100000:3.0:1787764761.652780:0:6649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764761.652806:0:6649:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfced8f9840 going to sleep for 11 seconds 00000100:00100000:1.0:1787764761.652820:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176948480 00000100:00100000:1.0:1787764761.652836:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176948480 00000100:00100000:1.0:1787764761.652869:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787764761.652878:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+11:6649:x1874607176948480:12345-0@lo:502: 00000100:00100000:1.0:1787764761.653027:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+11:6649:x1874607176948480:12345-0@lo:502: Request processed in 149us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764761.653034:0:6649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176948480:0@lo:502: 00000100:00100000:1.0:1787764761.653035:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000040:00080000:3.0:1787764761.653118:0:6649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1787764761.653129:0:6649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1787764761.654603:0:6674:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787764761.654641:0:6674:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9dfbc11e0000) 00000020:00000080:1.0:1787764761.654660:0:6674:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1787764761.654729:0:6674:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dfcf55aa800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787764761.654733:0:6674:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dfcf55aa800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787764761.654736:0:6674:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dfcf55aa800 3 00010000:00080000:1.0:1787764761.654771:0:6674:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dfcc5c25000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.153@tcp at head 00010000:00010000:1.0:1787764761.656718:0:6674:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1787764761.656897:0:6674:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787764761.656927:0:6674:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787764761.656934:0:6674:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xdf82b4f42fb37a2e 00000100:00080000:1.0:1787764761.656945:0:6674:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787764761.656948:0:6674:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dfcc5c25000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:1.0:1787764761.656975:0:6674:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dfcdaa90780 x1874607176948608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787764761.656997:0:6674:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787764761.657062:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1874607176948608:0@lo:38: 00000100:00100000:3.0:1787764761.657152:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1787764761.657231:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:3.0:1787764761.657234:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176948608 00000100:00100000:3.0:1787764761.657242:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176948608 00000100:00100000:3.0:1787764761.657276:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787764761.657284:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc32fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1874607176948608:12345-0@lo:38: 00010000:00080000:3.0:1787764761.657316:0:5808:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 100 last 0 00000020:00000080:3.0:1787764761.657361:0:5808:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xdf82b4f42fb37a35 00000004:00100000:3.0:1787764761.657377:0:5808:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787764761.657404:0:5808:0:(import.c:65:import_set_state_nolock()) ffff9dfcffb12000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787764761.657458:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc32fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874607176948608:12345-0@lo:38: Request processed in 174us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764761.657466:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:3.0:1787764761.657509:0:6649:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1787764761.657532:0:6649:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787764761.657548:0:6649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcdab66000/0xdf82b4f42fb37a19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37a20 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764761.657557:0:6649:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff9dfcdab66000/0xdf82b4f42fb37a19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37a20 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787764761.657635:0:6649:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787764761.657638:0:6649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787764761.657640:0:6649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787764761.657641:0:6649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787764761.657643:0:6649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787764761.657644:0:6649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787764761.657646:0:6649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787764761.657648:0:6649:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787764761.657650:0:6649:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787764761.657652:0:6649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787764761.657654:0:6649:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787764761.657657:0:6649:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1787764761.657660:0:6649:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787764761.657662:0:6649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787764761.657663:0:6649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787764761.657664:0:6649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787764761.657666:0:6649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787764761.657667:0:6649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787764761.657673:0:6649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787764761.657674:0:6649:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787764761.657675:0:6649:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787764761.657677:0:6649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787764761.657679:0:6649:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00080000:1.0:1787764761.657680:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9dfcdaa90780 x1874607176948608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787764771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764761.657690:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 10000000:01000000:3.0:1787764761.657693:0:6649:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00080000:1.0:1787764761.657697:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1787764761.657706:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00100000:3.0:1787764761.657706:0:6649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176948736:0@lo:253: 00000100:00080000:1.0:1787764761.657712:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787764761.657715:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9dfcc5c25000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787764761.657732:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1874607176948608:0@lo:38: 00000100:00100000:3.0:1787764761.657749:0:6649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764761.657790:0:6649:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfced8f9540 going to sleep for 11 seconds 00000100:00100000:1.0:1787764761.657830:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176948736 00000100:00100000:1.0:1787764761.657835:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176948736 00000100:00100000:1.0:1787764761.657867:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787764761.657873:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+11:6649:x1874607176948736:12345-0@lo:253: 20000000:01000000:1.0:1787764761.657894:0:5802:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787764761.657907:0:5802:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787764761.658309:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787764761.658319:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1874607176948864:0@lo:400: 00000100:00100000:0.0:1787764761.658354:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764761.658390:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176948864 00000100:00100000:1.0:1787764761.658395:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176948864 00000100:00100000:1.0:1787764761.658431:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787764761.658439:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaa4bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1874607176948864:12345-0@lo:400: 00000100:00100000:1.0:1787764761.658481:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaa4bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1874607176948864:12345-0@lo:400: Request processed in 42us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764761.658488:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787764761.658527:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9dfcdaa483c0 x1874607176948864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787764777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764761.658537:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1874607176948864:0@lo:400: 20000000:01000000:0.0:1787764761.681651:0:5802:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787764761.681669:0:5802:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787764761.681681:0:5824:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787764761.681687:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787764761.681710:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dfcdab67a00/0xdf82b4f42fb37a3c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764761.681725:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfcdab67a00/0xdf82b4f42fb37a3c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787764761.681735:0:5824:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000908633s 00010000:00010000:3.0:1787764761.681739:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dfcdab67a00/0xdf82b4f42fb37a3c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764761.681747:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dfcdab67a00/0xdf82b4f42fb37a3c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764761.681754:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dfcdab67a00/0xdf82b4f42fb37a3c lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764761.681761:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dfcdab67a00/0xdf82b4f42fb37a3c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764761.681767:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcdab67a00 already unused, calling callback (ffffffffc16cb530) 00010000:00010000:3.0:1787764761.681771:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dfcdab67a00/0xdf82b4f42fb37a3c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764761.681792:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dfcdab67a00/0xdf82b4f42fb37a3c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764761.681806:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dfcdab67a00/0xdf82b4f42fb37a3c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764761.681815:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dfcdab67a00/0xdf82b4f42fb37a3c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764761.681822:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dfcdab67a00/0xdf82b4f42fb37a3c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764761.687429:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+11:6649:x1874607176948736:12345-0@lo:253: Request processed in 29547us (29673us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764761.687445:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787764761.687586:0:6649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6649:1874607176948736:0@lo:253: 10000000:01000000:0.0:1787764761.687695:0:6649:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787764761.687700:0:6649:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787764761.687702:0:6649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787764761.687703:0:6649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787764761.687705:0:6649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787764761.687706:0:6649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787764761.687707:0:6649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787764761.687709:0:6649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787764761.687711:0:6649:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787764761.687712:0:6649:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787764761.687714:0:6649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787764761.687716:0:6649:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787764761.687731:0:6649:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787764761.692582:0:6649:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787764761.692875:0:6649:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787764761.693058:0:6649:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787764761.693267:0:6649:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787764761.693515:0:6649:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:0.0:1787764761.693792:0:6649:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787764761.694450:0:6649:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 10000000:01000000:3.0:1787764761.735154:0:5806:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787764761.735162:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dfce623b000 from 21 10000000:01000000:3.0:1787764761.735167:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787764761.735207:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67a00/0xdf82b4f42fb37a43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764761.735218:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67a00/0xdf82b4f42fb37a43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764761.735228:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67a00/0xdf82b4f42fb37a43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764761.735249:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176948992:0@lo:101: 00000100:00100000:3.0:1787764761.735315:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764761.735367:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176948992 00000100:00100000:2.0:1787764761.735375:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176948992 00000100:00100000:3.0:1787764761.735377:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfced8f9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787764761.735421:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787764761.735433:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+11:5806:x1874607176948992:12345-0@lo:101: 00010000:00010000:2.0:1787764761.735446:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764761.735459:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dfcc92b3a00/0xdf82b4f42fb37a4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb37a43 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764761.735485:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfcc92b3a00/0xdf82b4f42fb37a4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb37a43 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764761.735496:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dfcc92b3a00/0xdf82b4f42fb37a4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37a43 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764761.735506:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcc92b3a00, rc 0) 00000100:00100000:2.0:1787764761.735545:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:5806:x1874607176948992:12345-0@lo:101: Request processed in 116us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764761.735552:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787764761.735571:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176948992:0@lo:101: 00010000:00010000:3.0:1787764761.735589:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67a00/0xdf82b4f42fb37a43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37a4a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764761.735599:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67a00/0xdf82b4f42fb37a43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf82b4f42fb37a4a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764761.735681:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176949120:0@lo:501: 00000100:00100000:3.0:1787764761.735714:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764761.735734:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfced8f9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787764761.735758:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176949120 00000100:00100000:2.0:1787764761.735763:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176949120 00000100:00100000:2.0:1787764761.735788:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787764761.735795:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:5806:x1874607176949120:12345-0@lo:501: 00000100:00100000:2.0:1787764761.736005:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:5806:x1874607176949120:12345-0@lo:501: Request processed in 210us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764761.736012:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787764761.736059:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176949120:0@lo:501: 00000100:00100000:3.0:1787764761.736111:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176949248:0@lo:503: 00000100:00100000:3.0:1787764761.736154:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764761.736184:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfced8f9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787764761.736198:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176949248 00000100:00100000:3.0:1787764761.736202:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176949248 00000100:00100000:3.0:1787764761.736228:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787764761.736235:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:5806:x1874607176949248:12345-0@lo:503: 00000100:00100000:3.0:1787764761.736430:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:5806:x1874607176949248:12345-0@lo:503: Request processed in 194us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764761.736439:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787764761.736483:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176949248:0@lo:503: 00000100:00100000:2.0:1787764761.736713:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaab7840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6678:1874607176949376:0@lo:502: 00000100:00100000:2.0:1787764761.736750:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764761.736768:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcd967ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1787764761.736798:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176949376 00000100:00100000:3.0:1787764761.736804:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176949376 00000100:00100000:3.0:1787764761.736837:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787764761.736845:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:6678:x1874607176949376:12345-0@lo:502: 00000100:00100000:3.0:1787764761.737030:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:6678:x1874607176949376:12345-0@lo:502: Request processed in 185us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764761.737037:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787764761.737198:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaab7840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6678:1874607176949376:0@lo:502: 00000100:00100000:1.0:1787764761.737239:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa90780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6678:1874607176949504:0@lo:502: 00000100:00100000:1.0:1787764761.737276:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764761.737301:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc56ba180 going to sleep for 11 seconds 00000100:00100000:3.0:1787764761.737323:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176949504 00000100:00100000:3.0:1787764761.737328:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176949504 00000100:00100000:3.0:1787764761.737359:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787764761.737368:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:6678:x1874607176949504:12345-0@lo:502: 00000100:00100000:3.0:1787764761.737526:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:6678:x1874607176949504:12345-0@lo:502: Request processed in 158us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764761.737535:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787764761.737541:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa90780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6678:1874607176949504:0@lo:502: 00000040:00080000:2.0:1787764761.737568:0:6678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1787764761.737648:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1787764761.737670:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787764761.737680:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67a00/0xdf82b4f42fb37a43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37a4a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764761.737691:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67a00/0xdf82b4f42fb37a43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37a4a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787764761.737701:0:5806:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787764761.737703:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dfce623b000 from 3 10000000:01000000:3.0:1787764761.737706:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787764761.737732:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67200/0xdf82b4f42fb37a51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764761.737741:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67200/0xdf82b4f42fb37a51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764761.737750:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67200/0xdf82b4f42fb37a51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764761.737773:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176949632:0@lo:101: 00000100:00100000:3.0:1787764761.737816:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764761.737836:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfced8f9540 going to sleep for 11 seconds 00000100:00100000:2.0:1787764761.737893:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176949632 00000100:00100000:2.0:1787764761.737897:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176949632 00000100:00100000:2.0:1787764761.737922:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787764761.737929:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:5806:x1874607176949632:12345-0@lo:101: 00010000:00010000:2.0:1787764761.737937:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764761.737949:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dfcc92b2c00/0xdf82b4f42fb37a58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb37a51 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764761.737970:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfcc92b2c00/0xdf82b4f42fb37a58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb37a51 expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764761.737980:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dfcc92b2c00/0xdf82b4f42fb37a58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37a51 expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764761.737989:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcc92b2c00, rc 0) 00000100:00100000:3.0:1787764761.738063:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176949632:0@lo:101: 00000100:00100000:2.0:1787764761.738065:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+13:5806:x1874607176949632:12345-0@lo:101: Request processed in 136us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764761.738075:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:3.0:1787764761.738101:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67200/0xdf82b4f42fb37a51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37a58 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764761.738112:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67200/0xdf82b4f42fb37a51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf82b4f42fb37a58 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764761.738165:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176949760:0@lo:256: 00000100:00100000:3.0:1787764761.738201:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764761.738222:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfced8f9540 going to sleep for 11 seconds 00000100:00100000:3.0:1787764761.738233:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176949760 00000100:00100000:3.0:1787764761.738236:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176949760 00000100:00100000:3.0:1787764761.738259:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787764761.738267:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+13:5806:x1874607176949760:12345-0@lo:256: 20000000:01000000:3.0:1787764761.738281:0:5804:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787764761.738300:0:5804:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787764761.738305:0:5804:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1787764761.738308:0:5804:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 88, version 4 00000100:00100000:2.0:1787764761.741287:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+13:5806:x1874607176949760:12345-0@lo:256: Request processed in 3011us (3076us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764761.741305:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787764761.741366:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176949760:0@lo:256: 10000000:01000000:2.0:1787764761.741420:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787764761.741429:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67200/0xdf82b4f42fb37a51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37a58 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764761.741440:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67200/0xdf82b4f42fb37a51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37a58 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787764761.741454:0:5806:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787764761.741457:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1787764761.741460:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787764761.741496:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2800/0xdf82b4f42fb37a5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764761.741505:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2800/0xdf82b4f42fb37a5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764761.741514:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2800/0xdf82b4f42fb37a5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764761.741532:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaab70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176949888:0@lo:101: 00000100:00100000:2.0:1787764761.741566:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764761.741595:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcd967ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787764761.741621:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176949888 00000100:00100000:2.0:1787764761.741627:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176949888 00000100:00100000:2.0:1787764761.741658:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787764761.741668:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+13:5806:x1874607176949888:12345-0@lo:101: 00010000:00010000:2.0:1787764761.741681:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764761.741693:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dfcc92b2400/0xdf82b4f42fb37a66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb37a5f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764761.741716:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfcc92b2400/0xdf82b4f42fb37a66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb37a5f expref: 14 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764761.741727:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dfcc92b2400/0xdf82b4f42fb37a66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37a5f expref: 14 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764761.741745:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcc92b2400, rc 0) 00000100:00100000:2.0:1787764761.741777:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:5806:x1874607176949888:12345-0@lo:101: Request processed in 111us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764761.741783:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787764761.741833:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaab70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176949888:0@lo:101: 00010000:00010000:2.0:1787764761.741848:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2800/0xdf82b4f42fb37a5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37a66 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764761.741858:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2800/0xdf82b4f42fb37a5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf82b4f42fb37a66 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764761.741914:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaab70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176950016:0@lo:501: 00000100:00100000:2.0:1787764761.741947:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764761.741966:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcd967ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787764761.741981:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176950016 00000100:00100000:2.0:1787764761.741984:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176950016 00000100:00100000:2.0:1787764761.742011:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787764761.742019:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:5806:x1874607176950016:12345-0@lo:501: 00000100:00100000:2.0:1787764761.742291:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:5806:x1874607176950016:12345-0@lo:501: Request processed in 274us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764761.742298:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787764761.753117:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaab70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176950016:0@lo:501: 00000100:00100000:2.0:1787764761.753179:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaab70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176950144:0@lo:503: 00000100:00100000:2.0:1787764761.753248:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764761.753297:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcd967ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787764761.754283:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176950144 00000100:00100000:1.0:1787764761.754309:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176950144 00000100:00100000:1.0:1787764761.754358:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787764761.754373:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:5806:x1874607176950144:12345-0@lo:503: 00000100:00100000:1.0:1787764761.755032:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:5806:x1874607176950144:12345-0@lo:503: Request processed in 662us (1784us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764761.755041:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787764761.755161:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaab70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176950144:0@lo:503: 00000100:00100000:2.0:1787764761.756002:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaab5e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6679:1874607176950272:0@lo:502: 00000100:00100000:3.0:1787764761.757414:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764761.757472:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc66b3000 going to sleep for 11 seconds 00000100:00100000:2.0:1787764761.757634:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176950272 00000100:00100000:2.0:1787764761.757642:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176950272 00000100:00100000:2.0:1787764761.757690:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787764761.757700:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:6679:x1874607176950272:12345-0@lo:502: 00000100:00100000:2.0:1787764761.757980:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:6679:x1874607176950272:12345-0@lo:502: Request processed in 281us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764761.757989:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787764761.758110:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaab5e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6679:1874607176950272:0@lo:502: 00000020:01000000:2.0:1787764761.758154:0:6679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787764761.758163:0:6679:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787764761.758170:0:6679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787764761.758173:0:6679:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787764761.758179:0:6679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787764761.758184:0:6679:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.153@tcp to nid 0x20000c0a8ca99 (192.168.202.153@tcp) 00000020:01000000:2.0:1787764761.758210:0:6679:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787764761.758215:0:6679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787764761.758229:0:6679:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9dfcc36e0000) 00000020:00000080:2.0:1787764761.758253:0:6679:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1787764761.758260:0:6679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787764761.758460:0:6679:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787764761.758468:0:6679:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787764761.758478:0:6679:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdf82b4f42fb37a74 00010000:00080000:2.0:1787764761.758515:0:6679:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dfbc21eb800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.153@tcp at head 00010000:00010000:2.0:1787764761.762299:0:6679:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1787764761.788035:0:6679:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787764761.788056:0:6679:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787764761.788910:0:6679:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787764761.789075:0:6679:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787764761.789178:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1787764761.789247:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1787764761.789793:0:6680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787764761.789798:0:6680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787764761.790834:0:6679:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787764761.790847:0:6679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787764761.790885:0:6679:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787764761.790906:0:6679:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdf82b4f42fb37a7b 00000100:00080000:2.0:1787764761.790917:0:6679:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787764761.790924:0:6679:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9dfbc21eb800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:2.0:1787764761.790957:0:6679:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dfcdaab5e00 x1874607176950400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787764761.790982:0:6679:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1787764761.791027:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaab5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1874607176950400:0@lo:8: 00000020:01000000:2.0:1787764761.791066:0:6679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787764761.791071:0:6679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787764761.791073:0:6679:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787764761.791077:0:6679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787764761.791106:0:6679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787764761.791108:0:6679:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000100:00100000:1.0:1787764761.791114:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1787764761.791116:0:6679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787764761.791120:0:6679:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787764761.791146:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaab5a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6679:1874607176950528:0@lo:502: 00000100:00100000:3.0:1787764761.791181:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176950400 00000100:00100000:3.0:1787764761.791189:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176950400 00000100:00100000:2.0:1787764761.791206:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764761.791229:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc66b3840 going to sleep for 11 seconds 00000100:00100000:3.0:1787764761.791230:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787764761.791241:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaa90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3285:x1874607176950400:12345-0@lo:8: 00000100:00100000:1.0:1787764761.791244:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176950528 00000100:00100000:1.0:1787764761.791249:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176950528 00000100:00100000:1.0:1787764761.791279:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787764761.791288:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:6679:x1874607176950528:12345-0@lo:502: 00000100:00100000:3.0:1787764761.791311:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaa90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3285:x1874607176950400:12345-0@lo:8: Request processed in 70us (198us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787764761.791320:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787764761.791559:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787764761.791568:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9dfbc21eb800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787764761.791573:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787764761.791578:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaab5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1874607176950400:0@lo:8: 00000100:00100000:1.0:1787764761.791585:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:6679:x1874607176950528:12345-0@lo:502: Request processed in 298us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764761.791591:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787764761.791653:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaab5a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6679:1874607176950528:0@lo:502: 00000020:01000000:1.0:1787764761.791688:0:6679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787764761.791698:0:6679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787764761.791700:0:6679:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787764761.791705:0:6679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1787764761.791813:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1787764761.791831:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787764761.791840:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2800/0xdf82b4f42fb37a5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37a66 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764761.791864:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2800/0xdf82b4f42fb37a5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37a66 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787764761.791875:0:5806:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787764761.791878:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dfce623b000 from 1 10000000:01000000:1.0:1787764761.791881:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787764761.791908:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfce1d34c00/0xdf82b4f42fb37a82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764761.791916:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff9dfce1d34c00/0xdf82b4f42fb37a82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764761.791924:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff9dfce1d34c00/0xdf82b4f42fb37a82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764761.791937:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa91e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176950656:0@lo:101: 00000100:00100000:1.0:1787764761.791969:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764761.791996:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc56baa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787764761.792099:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176950656 00000100:00100000:2.0:1787764761.792104:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176950656 00000100:00100000:2.0:1787764761.792141:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787764761.792150:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:5806:x1874607176950656:12345-0@lo:101: 00010000:00010000:2.0:1787764761.792160:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764761.792172:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dfcc92b2200/0xdf82b4f42fb37a89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb37a82 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764761.792201:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfcc92b2200/0xdf82b4f42fb37a89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb37a82 expref: 15 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764761.792213:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dfcc92b2200/0xdf82b4f42fb37a89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37a82 expref: 15 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764761.792222:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcc92b2200, rc 0) 00000100:00100000:2.0:1787764761.792256:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+15:5806:x1874607176950656:12345-0@lo:101: Request processed in 108us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764761.792263:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787764761.792269:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa91e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176950656:0@lo:101: 00010000:00010000:1.0:1787764761.792283:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff9dfce1d34c00/0xdf82b4f42fb37a82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37a89 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764761.792291:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff9dfce1d34c00/0xdf82b4f42fb37a82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf82b4f42fb37a89 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764761.792344:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa91e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176950784:0@lo:501: 00000100:00100000:1.0:1787764761.792374:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764761.792406:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176950784 00000100:00100000:1.0:1787764761.792409:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc56baa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787764761.792411:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176950784 00000100:00100000:0.0:1787764761.792442:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787764761.792449:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+15:5806:x1874607176950784:12345-0@lo:501: 00000100:00100000:0.0:1787764761.792601:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+15:5806:x1874607176950784:12345-0@lo:501: Request processed in 152us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764761.792624:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787764761.792629:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa91e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176950784:0@lo:501: 00000100:00100000:1.0:1787764761.792651:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa91e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176950912:0@lo:503: 00000100:00100000:1.0:1787764761.792687:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764761.792710:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc56baa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787764761.792718:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176950912 00000100:00100000:3.0:1787764761.792723:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176950912 00000100:00100000:3.0:1787764761.792752:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787764761.792758:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+15:5806:x1874607176950912:12345-0@lo:503: 00000100:00100000:3.0:1787764761.792974:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+15:5806:x1874607176950912:12345-0@lo:503: Request processed in 214us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764761.792982:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787764761.793002:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa91e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176950912:0@lo:503: 00000100:00100000:3.0:1787764761.793363:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32ff840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6682:1874607176951040:0@lo:502: 00000100:00100000:3.0:1787764761.793400:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764761.793432:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfced8f96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787764761.793444:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176951040 00000100:00100000:0.0:1787764761.793449:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176951040 00000100:00100000:0.0:1787764761.793475:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787764761.793480:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc5d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+15:6682:x1874607176951040:12345-0@lo:502: 00000100:00100000:0.0:1787764761.793582:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc5d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+15:6682:x1874607176951040:12345-0@lo:502: Request processed in 102us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764761.793588:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787764761.793619:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32ff840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6682:1874607176951040:0@lo:502: 00000020:01000000:3.0:1787764761.793644:0:6682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787764761.793651:0:6682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787764761.793654:0:6682:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787764761.793661:0:6682:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dfce623b000 00000020:00000080:3.0:1787764761.793664:0:6682:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787764761.793686:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32ff840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6682:1874607176951168:0@lo:502: 00000100:00100000:3.0:1787764761.793724:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764761.793754:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfced8f96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787764761.793770:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176951168 00000100:00100000:2.0:1787764761.793776:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176951168 00000100:00100000:2.0:1787764761.793801:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787764761.793807:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc5d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+15:6682:x1874607176951168:12345-0@lo:502: 00000100:00100000:2.0:1787764761.793927:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc5d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+15:6682:x1874607176951168:12345-0@lo:502: Request processed in 119us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764761.793934:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787764761.793979:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32ff840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:6682:1874607176951168:0@lo:502: 00000020:01000000:2.0:1787764761.794067:0:6682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787764761.794073:0:6682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787764761.794075:0:6682:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787764761.794101:0:6682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1787764761.794163:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787764761.794181:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787764761.794190:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfce1d34c00/0xdf82b4f42fb37a82 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37a89 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764761.794201:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff9dfce1d34c00/0xdf82b4f42fb37a82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37a89 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787764761.794210:0:5806:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787764761.794212:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9dfcc4e21a48 from 1 10000000:01000000:1.0:1787764761.794214:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787764761.794232:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfce1d35a00/0xdf82b4f42fb37a90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764761.794238:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff9dfce1d35a00/0xdf82b4f42fb37a90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764761.794245:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff9dfce1d35a00/0xdf82b4f42fb37a90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764761.794263:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa91e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176951296:0@lo:101: 00000100:00100000:1.0:1787764761.794289:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764761.794315:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176951296 00000100:00100000:0.0:1787764761.794319:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176951296 00000100:00100000:1.0:1787764761.794324:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc56ba000 going to sleep for 11 seconds 00000100:00100000:0.0:1787764761.794352:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00002000:00080000:1.0:1787764761.794358:0:6649:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00000100:00100000:0.0:1787764761.794363:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc5d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+15:5806:x1874607176951296:12345-0@lo:101: 00100000:10000000:1.0:1787764761.794365:0:6649:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00010000:00010000:0.0:1787764761.794374:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787764761.794385:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dfcc0030a00/0xdf82b4f42fb37a97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb37a90 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787764761.794397:0:6649:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 00010000:00010000:0.0:1787764761.794402:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfcc0030a00/0xdf82b4f42fb37a97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb37a90 expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764761.794422:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dfcc0030a00/0xdf82b4f42fb37a97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37a90 expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764761.794430:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcc0030a00, rc 0) 10000000:01000000:1.0:1787764761.794452:0:6649:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.153@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787764761.794470:0:6649:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000100:00100000:0.0:1787764761.794472:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc5d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+16:5806:x1874607176951296:12345-0@lo:101: Request processed in 113us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764761.794478:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000080:00000004:1.0:1787764761.794498:0:6649:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00000100:00100000:3.0:1787764761.794510:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa91e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176951296:0@lo:101: 00010000:00010000:3.0:1787764761.794525:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff9dfce1d35a00/0xdf82b4f42fb37a90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37a97 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764761.794535:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff9dfce1d35a00/0xdf82b4f42fb37a90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf82b4f42fb37a97 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764761.794576:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176951424:0@lo:501: 00000100:00100000:3.0:1787764761.794603:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764761.794634:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfced8f96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787764761.794651:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176951424 00000100:00100000:2.0:1787764761.794656:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176951424 00000100:00100000:2.0:1787764761.794683:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787764761.794690:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc5d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+16:5806:x1874607176951424:12345-0@lo:501: 00000100:00100000:2.0:1787764761.794927:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc5d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+16:5806:x1874607176951424:12345-0@lo:501: Request processed in 235us (322us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787764761.794944:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787764761.795077:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176951424:0@lo:501: 10000000:01000000:3.0:1787764761.795138:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787764761.795144:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfce1d35a00/0xdf82b4f42fb37a90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37a97 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764761.795154:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff9dfce1d35a00/0xdf82b4f42fb37a90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37a97 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764762.076562:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764763.095413:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764764.120484:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764765.143224:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764766.167675:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787764766.935755:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaab4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3287:1874607176951552:0@lo:400: 00000100:00100000:1.0:1787764766.935824:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787764766.935983:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787764766.935988:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787764766.935992:0:37:0:(import.c:65:import_set_state_nolock()) ffff9dfbc21eb800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787764766.936003:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9dfbc21eb800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:3.0:1787764766.936003:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaab6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1874607176951680:0@lo:400: 00000100:00100000:2.0:1787764766.936025:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dfcdaab5e00 x1874607176951936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787764766.936047:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764766.936061:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaab5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1874607176951808:0@lo:400: 00000100:00100000:2.0:1787764766.936077:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaab5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1874607176951936:0@lo:8: 00000100:00100000:3.0:1787764766.936125:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176951680 00000100:00100000:2.0:1787764766.936129:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764766.936133:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176951680 00000100:00100000:1.0:1787764766.936168:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764766.936177:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176951808 00000100:00100000:3.0:1787764766.936182:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176951808 00000100:00100000:1.0:1787764766.936206:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176951936 00000100:00100000:1.0:1787764766.936211:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176951936 00000100:00100000:3.0:1787764766.936220:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787764766.936231:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc32fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1874607176951680:12345-0@lo:400: 00000100:00100000:1.0:1787764766.936239:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787764766.936245:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaab70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3285:x1874607176951936:12345-0@lo:8: 00010000:00080000:1.0:1787764766.936268:0:6654:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 105 last 0 00000020:00000080:1.0:1787764766.936296:0:6654:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdf82b4f42fb37a9e 00000100:00100000:3.0:1787764766.936297:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc32fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1874607176951680:12345-0@lo:400: Request processed in 67us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764766.936315:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787764766.936323:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00100000:1.0:1787764766.936333:0:6654:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9dfcc5c23000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113976 ocd_grant: 0 ocd_index: 0 ocd_group 0 00000100:00100000:3.0:1787764766.936336:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00002000:00080000:1.0:1787764766.936343:0:6654:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1787764766.936347:0:6654:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1787764766.936350:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaa93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1874607176951808:12345-0@lo:400: 00010000:00080000:3.0:1787764766.936423:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dfcdaab6d00 x1874607176951680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787764782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764766.936439:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaab6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1874607176951680:0@lo:400: 00002000:00100000:1.0:1787764766.936450:0:6654:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787764766.936671:0:6654:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787764766.936701:0:6654:0:(import.c:65:import_set_state_nolock()) ffff9dfcc5c26000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787764766.936748:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaab70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3285:x1874607176951936:12345-0@lo:8: Request processed in 501us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764766.936755:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787764766.936792:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dfcdaab5e00 x1874607176951936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787764776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764766.936792:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaa93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1874607176951808:12345-0@lo:400: Request processed in 443us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764766.936807:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1787764766.936811:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787764766.936819:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787764766.936824:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787764766.936827:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9dfbc21eb800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787764766.936840:0:3285:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787764766.936846:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaab5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1874607176951936:0@lo:8: 00000100:00100000:0.0:1787764766.936899:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176951552 00000100:00100000:0.0:1787764766.936904:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176951552 00000100:00100000:0.0:1787764766.936931:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787764766.936938:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc5d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+16:3287:x1874607176951552:12345-0@lo:400: 00000100:00100000:0.0:1787764766.936986:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc5d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+16:3287:x1874607176951552:12345-0@lo:400: Request processed in 49us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764766.936992:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000004:00080000:0.0:1787764766.937019:0:6680:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787764766.937138:0:6680:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 105953055473ns, next at 0ns, rc = 0 00000100:00100000:0.0:1787764766.937255:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaab4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3287:1874607176951552:0@lo:400: 00010000:00080000:0.0:1787764766.937370:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dfcdaab5a40 x1874607176951808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787764782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764766.937381:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaab5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1874607176951808:0@lo:400: 00000004:00080000:1.0:1787764766.961803:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1787764766.962396:0:6681:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787764766.962410:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176952064:0@lo:13: 00000100:00100000:3.0:1787764766.962421:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32ffc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6681:1874607176952192:0@lo:7: 00000100:00100000:0.0:1787764766.962475:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764766.962475:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764766.962522:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176952064 00000100:00100000:2.0:1787764766.962522:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176952192 00000100:00100000:3.0:1787764766.962523:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfced8ee540 going to sleep for 11 seconds 00000100:00100000:1.0:1787764766.962531:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176952064 00000100:00100000:2.0:1787764766.962531:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176952192 00000100:00100000:1.0:1787764766.962591:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787764766.962596:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787764766.962602:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaa4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1874607176952064:12345-0@lo:13: 00000100:00080000:3.0:1787764766.962604:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787764766.962606:0:6651:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787764766.962607:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc32ff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6681:x1874607176952192:12345-0@lo:7: 00000100:00100000:0.0:1787764766.962627:0:6651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00000024:1.0:1787764766.962637:0:6655:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1787764766.962689:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaa4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1874607176952064:12345-0@lo:13: Request processed in 89us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764766.962696:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787764766.962714:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dfcc32fcb40 x1874607176952064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764782 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764766.962731:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176952064:0@lo:13: 00002000:00080000:2.0:1787764766.966414:0:6653:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1787764766.966420:0:6653:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787764766.966480:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc32ff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6681:x1874607176952192:12345-0@lo:7: Request processed in 3873us (4004us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764766.966488:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787764766.966506:0:6681:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dfcc32ffc00 x1874607176952192/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787764782 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764766.966518:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32ffc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6681:1874607176952192:0@lo:7: 00000004:00080000:3.0:1787764766.966531:0:6681:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787764766.966567:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32ffc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6681:1874607176952320:0@lo:5: 00000100:00100000:3.0:1787764766.966597:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764766.966643:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfced8ee540 going to sleep for 11 seconds 00000100:00100000:1.0:1787764766.966644:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176952320 00000100:00100000:1.0:1787764766.966652:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176952320 00000100:00100000:1.0:1787764766.966693:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787764766.966704:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc32fed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6681:x1874607176952320:12345-0@lo:5: 00002000:00080000:1.0:1787764766.966727:0:6654:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787764766.966731:0:6654:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1787764766.966958:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc32fed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:6681:x1874607176952320:12345-0@lo:5: Request processed in 256us (359us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787764766.966966:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787764766.967044:0:6681:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dfcc32ffc00 x1874607176952320/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787764782 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764766.967053:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32ffc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6681:1874607176952320:0@lo:5: 00000004:00080000:3.0:1787764766.967064:0:6681:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787764766.967110:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6681:1874607176952448:0@lo:700: 00000100:00100000:3.0:1787764766.967130:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764766.967149:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfced8ee540 going to sleep for 11 seconds 00000100:00100000:2.0:1787764766.967179:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176952448 00000100:00100000:2.0:1787764766.967185:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176952448 00000100:00100000:2.0:1787764766.967213:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787764766.967221:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc32fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6681:x1874607176952448:12345-0@lo:700: 00000100:00100000:2.0:1787764766.967250:0:6660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaab7840 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6660:1874607176952576:0@lo:700: 00000100:00100000:2.0:1787764766.967279:0:6660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764766.967303:0:6660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc893e480 going to sleep for 11 seconds 00000100:00100000:0.0:1787764766.967329:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176952576 00000100:00100000:0.0:1787764766.967334:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176952576 00000100:00100000:0.0:1787764766.967388:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787764766.967397:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaab4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6660:x1874607176952576:12345-0@lo:700: 40000000:02000000:2.0:1787764766.982872:0:5815:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1787764766.985871:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaab4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6660:x1874607176952576:12345-0@lo:700: Request processed in 18468us (18583us total) trans 0 rc 0/0 00010000:00080000:0.0:1787764766.985909:0:6660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dfcdaab7840 x1874607176952576/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787764782 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764766.985912:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787764766.985927:0:6660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaab7840 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6660:1874607176952576:0@lo:700: 40000000:02000000:0.0:1787764766.985942:0:6660:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:1.0:1787764767.010002:0:6683:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1787764767.010015:0:6683:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787764767.010065:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc32fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6681:x1874607176952448:12345-0@lo:700: Request processed in 42839us (42927us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764767.010114:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787764767.010124:0:6681:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dfcc32fc000 x1874607176952448/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787764782 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764767.010142:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6681:1874607176952448:0@lo:700: 00000004:02000040:3.0:1787764767.017930:0:6681:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1787764767.020752:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6681:1874607176952704:0@lo:5: 00000100:00100000:3.0:1787764767.020825:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764767.020899:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfced8ee780 going to sleep for 11 seconds 00000100:00100000:1.0:1787764767.020964:0:6794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176952704 00000100:00100000:1.0:1787764767.020970:0:6794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176952704 00000100:00100000:1.0:1787764767.021011:0:6794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787764767.021018:0:6794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced26d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:6681:x1874607176952704:12345-0@lo:5: 00002000:00080000:1.0:1787764767.024681:0:6794:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1787764767.024696:0:6794:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1787764767.026326:0:6794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced26d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:6681:x1874607176952704:12345-0@lo:5: Request processed in 5304us (5496us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787764767.026336:0:6794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787764767.026378:0:6681:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dfcc32fc000 x1874607176952704/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787764783 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764767.026393:0:6681:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787764767.026408:0:6681:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9dfcc32fc000 x1874607176952704/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787764783 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764767.026420:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6681:1874607176952704:0@lo:5: 00000004:00080000:3.0:1787764767.026434:0:6681:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1787764767.191315:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764768.216176:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764769.239286:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787764769.399520:0:7027:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787764770.263256:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764771.292928:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764772.056259:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaab4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176953216:0@lo:400: 00000100:00100000:2.0:1787764772.056345:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764772.056407:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787764772.056414:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaab43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3286:1874607176952832:0@lo:400: 00000100:00100000:2.0:1787764772.056442:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764772.056475:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaab7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1874607176952960:0@lo:400: 00000100:00100000:2.0:1787764772.056507:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764772.056538:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787764772.056544:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaab5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1874607176953088:0@lo:400: 00000100:00100000:2.0:1787764772.056587:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764772.056641:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176953216 00000100:00100000:2.0:1787764772.056648:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176953216 00000100:00100000:2.0:1787764772.056705:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787764772.056715:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaab5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3286:x1874607176953216:12345-0@lo:400: 00000100:00100000:2.0:1787764772.056772:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaab5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3286:x1874607176953216:12345-0@lo:400: Request processed in 58us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764772.056780:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787764772.056807:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176952832 00000100:00100000:2.0:1787764772.056810:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176952832 00000100:00100000:2.0:1787764772.056843:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787764772.056850:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc5d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+16:3286:x1874607176952832:12345-0@lo:400: 00000100:00100000:2.0:1787764772.056879:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc5d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+16:3286:x1874607176952832:12345-0@lo:400: Request processed in 30us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764772.056894:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787764772.056931:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176952960 00000100:00100000:2.0:1787764772.056934:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176952960 00000100:00100000:2.0:1787764772.056955:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176953088 00000100:00100000:2.0:1787764772.056958:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176953088 00000100:00100000:2.0:1787764772.056979:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787764772.056985:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaab6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1874607176952960:12345-0@lo:400: 00000100:00100000:2.0:1787764772.057019:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaab6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1874607176952960:12345-0@lo:400: Request processed in 34us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764772.057025:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787764772.057035:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787764772.057041:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc668d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1874607176953088:12345-0@lo:400: 00000100:00100000:2.0:1787764772.057065:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc668d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1874607176953088:12345-0@lo:400: Request processed in 25us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764772.057072:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787764772.057118:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787764772.057123:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787764772.057155:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dfcdaab5a40 x1874607176953088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787764788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764772.057170:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaab5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1874607176953088:0@lo:400: 00010000:00080000:2.0:1787764772.057182:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dfcdaab7840 x1874607176952960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787764788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764772.057191:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaab7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1874607176952960:0@lo:400: 00000100:00100000:2.0:1787764772.057222:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaab43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3286:1874607176952832:0@lo:400: 00010000:00080000:2.0:1787764772.057231:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dfcdaab4000 x1874607176953216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764772.057249:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaab4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176953216:0@lo:400: 00000100:00100000:3.0:1787764772.062701:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced26f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176953344:0@lo:13: 00000100:00100000:3.0:1787764772.062780:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764772.062822:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176953344 00000100:00100000:0.0:1787764772.062829:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176953344 00000100:00100000:0.0:1787764772.062872:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787764772.062881:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced26e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1874607176953344:12345-0@lo:13: 00002000:00000024:0.0:1787764772.062921:0:6656:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787764772.062968:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced26e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1874607176953344:12345-0@lo:13: Request processed in 88us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764772.062975:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787764772.063018:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dfced26f0c0 x1874607176953344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764788 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764772.063051:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced26f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176953344:0@lo:13: 00000001:00080000:2.0:1787764772.137996:0:6683:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1787764772.311218:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764773.335203:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764774.359273:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787764774.949775:0:7596:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787764774.949779:0:7596:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1787764774.949890:0:7596:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9dfcffb13800 00000020:01000004:3.0:1787764774.949906:0:7596:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787764774.949916:0:7596:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1787764774.949933:0:7596:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9dfced151a48) 00000020:00000080:3.0:1787764774.949944:0:7596:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787764774.959240:0:7596:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787764774.959453:0:7596:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787764774.972004:0:7596:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787764774.975348:0:7596:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787764774.975371:0:7596:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787764774.975405:0:7596:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787764774.975421:0:7596:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787764774.975716:0:7596:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787764774.975727:0:7596:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787764774.975735:0:7596:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdf82b4f42fb37aac 00000020:01000004:2.0:1787764774.975742:0:7596:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787764774.975763:0:7596:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.153@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787764774.975767:0:7596:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787764774.975772:0:7596:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787764774.975793:0:7596:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787764774.975797:0:7596:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.153@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787764774.987513:0:7596:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.153@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787764774.987547:0:7596:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.153@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787764774.987551:0:7596:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787764774.987553:0:7596:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787764774.987554:0:7596:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787764774.987555:0:7596:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787764774.987557:0:7596:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787764774.987558:0:7596:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787764774.987560:0:7596:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787764774.987565:0:7596:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787764774.987566:0:7596:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787764774.987567:0:7596:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787764774.987569:0:7596:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787764774.987572:0:7596:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787764774.987574:0:7596:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787764774.987575:0:7596:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787764774.987576:0:7596:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787764774.987577:0:7596:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787764774.987578:0:7596:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787764774.987579:0:7596:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787764774.987580:0:7596:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787764774.987581:0:7596:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787764774.987581:0:7596:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787764774.987582:0:7596:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787764774.987583:0:7596:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787764774.987606:0:7596:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787764774.987624:0:7596:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:7596:1874607176953472:0@lo:253: 00000100:00100000:2.0:1787764774.987693:0:7596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764774.987748:0:7596:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc893e000 going to sleep for 11 seconds 00000100:00100000:0.0:1787764774.987754:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176953472 00000100:00100000:0.0:1787764774.987760:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176953472 00000100:00100000:0.0:1787764774.987806:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787764774.987818:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc5d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+16:7596:x1874607176953472:12345-0@lo:253: 20000000:01000000:0.0:1787764774.987847:0:5804:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787764774.987850:0:5804:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1787764774.987855:0:5804:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1787764774.987859:0:5804:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1787764774.988633:0:5804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787764774.988835:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1787764774.988849:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1787764774.988879:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1787764774.988885:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1787764774.988901:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1787764774.988943:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1787764774.989275:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1787764774.989288:0:5804:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.153@tcp 20000000:01000000:0.0:1787764774.989290:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.153@tcp (null) (null) (null) 00000040:00080000:0.0:1787764774.989308:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1787764774.989313:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787764774.989348:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1787764774.989356:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.153@tcp (null) (null) 00000040:00080000:0.0:1787764774.989387:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1787764774.989395:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787764774.989412:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1787764774.989439:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1787764774.990098:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1787764774.990108:0:5804:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.153@tcp 20000000:01000000:0.0:1787764774.990114:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.153@tcp (null) (null) (null) 00000040:00080000:0.0:1787764774.990139:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1787764774.990143:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787764774.990161:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1787764774.990168:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.153@tcp (null) (null) 00000040:00080000:0.0:1787764774.990200:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1787764774.990209:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787764774.990243:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1787764774.990264:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1787764774.990274:0:5804:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787764774.990276:0:5804:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787764774.990278:0:5804:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787764774.990287:0:5804:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787764774.990289:0:5804:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787764774.990309:0:5804:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787764774.990311:0:5804:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787764774.990826:0:7598:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1787764774.990880:0:7598:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1787764774.990929:0:7598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1787764774.991195:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1787764774.991239:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1787764774.991300:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1787764774.991312:0:5804:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787764774.991314:0:5804:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787764774.991672:0:7599:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1787764774.991716:0:7599:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1787764774.991784:0:7599:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1787764774.991941:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1787764774.991998:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1787764774.992049:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1787764774.992061:0:5804:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787764774.992063:0:5804:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787764774.992405:0:7600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1787764774.992579:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1787764774.992614:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1787764774.992669:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1787764774.992683:0:5804:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787764774.992685:0:5804:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787764774.993157:0:7601:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1787764774.993229:0:7601:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1787764774.993265:0:7601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1787764774.993426:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1787764774.993450:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1787764774.993502:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1787764774.993515:0:5804:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1787764774.993517:0:5804:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1787764774.993524:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787764774.993541:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dfcc0031200/0xdf82b4f42fb37ab3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764774.993556:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dfcc92b2a00/0xdf82b4f42fb379f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb379ef expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764774.993564:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dfcc0030200/0xdf82b4f42fb37a20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37a19 expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764774.993571:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dfcc92b3a00/0xdf82b4f42fb37a4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37a43 expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764774.993578:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dfcc92b2400/0xdf82b4f42fb37a66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37a5f expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764774.993584:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dfcc0030a00/0xdf82b4f42fb37a97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37a90 expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764774.993594:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dfcc0031200/0xdf82b4f42fb37ab3 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764774.993646:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dfcc0030a00/0xdf82b4f42fb37a97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf82b4f42fb37a90 expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764774.993662:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dfcc0030a00/0xdf82b4f42fb37a97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf82b4f42fb37a90 expref: 16 pid: 5802 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764774.993676:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa4a940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5804:1874607176953600:0@lo:104: 00000100:00100000:0.0:1787764774.993746:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787764774.993799:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dfcc92b2400/0xdf82b4f42fb37a66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf82b4f42fb37a5f expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764774.993800:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176953600 00000100:00100000:1.0:1787764774.993806:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176953600 00010000:00010000:0.0:1787764774.993811:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dfcc92b2400/0xdf82b4f42fb37a66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf82b4f42fb37a5f expref: 16 pid: 5804 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764774.993818:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa49a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5804:1874607176953728:0@lo:104: 00000100:00100000:0.0:1787764774.993841:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764774.993862:0:5792:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1787764774.993871:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dfcc92b3a00/0xdf82b4f42fb37a4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf82b4f42fb37a43 expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764774.993872:0:6667:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/3 left), rc = 0 00000100:00100000:1.0:1787764774.993876:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176953728 00000100:00100000:1.0:1787764774.993881:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176953728 00010000:00010000:0.0:1787764774.993884:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dfcc92b3a00/0xdf82b4f42fb37a4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf82b4f42fb37a43 expref: 16 pid: 5803 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764774.993889:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787764774.993900:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa4b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5804:1874607176953856:0@lo:104: 00000100:00100000:2.0:1787764774.993907:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaa492c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+4:5804:x1874607176953600:12345-0@lo:104: 00000100:00100000:1.0:1787764774.993910:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1787764774.993924:0:6667:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff9dfce1d35a00/0xdf82b4f42fb37a90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37a97 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764774.993929:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764774.993941:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4e93050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+4:5804:x1874607176953728:12345-0@lo:104: 00010000:00010000:1.0:1787764774.993954:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2800/0xdf82b4f42fb37a5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37a66 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764774.993971:0:5791:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00010000:00010000:0.0:1787764774.993974:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dfcc0030200/0xdf82b4f42fb37a20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf82b4f42fb37a19 expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764774.993983:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_003' 00010000:00010000:0.0:1787764774.993985:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dfcc0030200/0xdf82b4f42fb37a20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf82b4f42fb37a19 expref: 16 pid: 5803 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764774.993998:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa48780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5804:1874607176953984:0@lo:104: 00010000:00010000:2.0:1787764774.993999:0:6667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1787764774.994009:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787764774.994010:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaa492c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+4:5804:x1874607176953600:12345-0@lo:104: Request processed in 108us (262us total) trans 0 rc 0/0 00010000:00010000:3.0:1787764774.994016:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1787764774.994020:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787764774.994028:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4e93050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+4:5804:x1874607176953728:12345-0@lo:104: Request processed in 91us (182us total) trans 0 rc 0/0 00010000:00010000:3.0:1787764774.994028:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff9dfce1d35a00/0xdf82b4f42fb37a90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37a97 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764774.994042:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764774.994043:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176953856 00000100:00100000:1.0:1787764774.994046:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787764774.994050:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176953856 00010000:00010000:3.0:1787764774.994052:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfce1d35a00 already unused, calling callback (ffffffffc1cc6c20) 10000000:00010000:3.0:1787764774.994066:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff9dfce1d35a00/0xdf82b4f42fb37a90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf82b4f42fb37a97 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764774.994067:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dfcc92b2a00/0xdf82b4f42fb379f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf82b4f42fb379ef expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764774.994102:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176953984 00000100:00100000:2.0:1787764774.994107:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176953984 00010000:00010000:0.0:1787764774.994115:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dfcc92b2a00/0xdf82b4f42fb379f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf82b4f42fb379ef expref: 16 pid: 5803 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764774.994117:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff9dfce1d35a00/0xdf82b4f42fb37a90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf82b4f42fb37a97 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764774.994129:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 10000000:00010000:3.0:1787764774.994137:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff9dfce1d35a00/0xdf82b4f42fb37a90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf82b4f42fb37a97 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764774.994141:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787764774.994144:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaa49e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+4:5804:x1874607176953856:12345-0@lo:104: 10000000:01000000:3.0:1787764774.994154:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1787764774.994156:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa4a580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5804:1874607176954112:0@lo:104: 00000100:00100000:2.0:1787764774.994157:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaa4b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+4:5804:x1874607176953984:12345-0@lo:104: 00010000:00010000:1.0:1787764774.994175:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67a00/0xdf82b4f42fb37a43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37a4a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764774.994183:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787764774.994185:0:6667:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff9dfcdab66000/0xdf82b4f42fb37a19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37a20 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764774.994188:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff9dfce1d35a00/0xdf82b4f42fb37a90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37a97 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764774.994205:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787764774.994225:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff9dfce1d35a00/0xdf82b4f42fb37a90 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37a97 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764774.994231:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1787764774.994234:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff9dfce1d35a00/0xdf82b4f42fb37a90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37a97 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764774.994240:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaa49e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+4:5804:x1874607176953856:12345-0@lo:104: Request processed in 100us (311us total) trans 0 rc 0/0 00010000:00010000:2.0:1787764774.994245:0:6667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:3.0:1787764774.994251:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:1.0:1787764774.994253:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787764774.994255:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaa4b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+4:5804:x1874607176953984:12345-0@lo:104: Request processed in 102us (215us total) trans 0 rc 0/0 00010000:00010000:3.0:1787764774.994266:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2800/0xdf82b4f42fb37a5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37a66 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764774.994268:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176954112 00000100:00100000:2.0:1787764774.994270:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1787764774.994286:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcc92b2800 already unused, calling callback (ffffffffc1cc6c20) 10000000:00010000:3.0:1787764774.994290:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2800/0xdf82b4f42fb37a5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf82b4f42fb37a66 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764774.994297:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2800/0xdf82b4f42fb37a5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf82b4f42fb37a66 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787764774.994303:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2800/0xdf82b4f42fb37a5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf82b4f42fb37a66 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787764774.994307:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787764774.994330:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2800/0xdf82b4f42fb37a5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37a66 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764774.994335:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787764774.994340:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2800/0xdf82b4f42fb37a5f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37a66 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764774.994346:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2800/0xdf82b4f42fb37a5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37a66 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764774.994357:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787764774.994360:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67a00/0xdf82b4f42fb37a43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37a4a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764774.994367:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcdab67a00 already unused, calling callback (ffffffffc1cc6c20) 10000000:00010000:3.0:1787764774.994370:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67a00/0xdf82b4f42fb37a43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf82b4f42fb37a4a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764774.994383:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176954112 00010000:00010000:3.0:1787764774.994390:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67a00/0xdf82b4f42fb37a43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf82b4f42fb37a4a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787764774.994399:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67a00/0xdf82b4f42fb37a43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf82b4f42fb37a4a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787764774.994405:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787764774.994417:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787764774.994422:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc6af40c0 going to sleep for 11 seconds 00010000:00010000:3.0:1787764774.994423:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67a00/0xdf82b4f42fb37a43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37a4a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764774.994428:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaa49680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+3:5804:x1874607176954112:12345-0@lo:104: 00010000:00010000:3.0:1787764774.994438:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787764774.994441:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff9dfcc0031800/0xdf82b4f42fb379ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb379f6 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764774.994443:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa4a940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5804:1874607176953600:0@lo:104: 00000100:00100000:0.0:1787764774.994456:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa49a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5804:1874607176953728:0@lo:104: 00010000:00010000:3.0:1787764774.994466:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67a00/0xdf82b4f42fb37a43 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37a4a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764774.994469:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa4b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5804:1874607176953856:0@lo:104: 00000100:00100000:2.0:1787764774.994470:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced26ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3286:1874607176954496:0@lo:103: 00010000:00010000:3.0:1787764774.994495:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67a00/0xdf82b4f42fb37a43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37a4a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764774.994500:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787764774.994510:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa48780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5804:1874607176953984:0@lo:104: 00000100:00100000:1.0:1787764774.994510:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaa49680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+3:5804:x1874607176954112:12345-0@lo:104: Request processed in 83us (325us total) trans 0 rc 0/0 00010000:00010000:3.0:1787764774.994510:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787764774.994518:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff9dfcdab66000/0xdf82b4f42fb37a19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37a20 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764774.994525:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787764774.994529:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa4a580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5804:1874607176954112:0@lo:104: 00010000:00010000:3.0:1787764774.994530:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcdab66000 already unused, calling callback (ffffffffc1cc6c20) 00000100:00100000:2.0:1787764774.994535:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:3.0:1787764774.994538:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff9dfcdab66000/0xdf82b4f42fb37a19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf82b4f42fb37a20 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764774.994547:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff9dfcdab66000/0xdf82b4f42fb37a19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf82b4f42fb37a20 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764774.994548:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787764774.994556:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff9dfcc0031800/0xdf82b4f42fb379ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb379f6 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787764774.994558:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff9dfcdab66000/0xdf82b4f42fb37a19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf82b4f42fb37a20 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764774.994566:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcc0031800 already unused, calling callback (ffffffffc1cc6c20) 10000000:01000000:3.0:1787764774.994571:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787764774.994573:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dfcc0031200/0xdf82b4f42fb37ab3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787764774.994579:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff9dfcc0031800/0xdf82b4f42fb379ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf82b4f42fb379f6 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764774.994591:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff9dfcc0031800/0xdf82b4f42fb379ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf82b4f42fb379f6 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764774.994593:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff9dfcdab66000/0xdf82b4f42fb37a19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37a20 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764774.994597:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176954496 00000100:00100000:0.0:1787764774.994602:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176954496 10000000:00010000:1.0:1787764774.994609:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff9dfcc0031800/0xdf82b4f42fb379ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf82b4f42fb379f6 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764774.994610:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787764774.994618:0:6286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dfcc92b3a00/0xdf82b4f42fb37a4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37a43 expref: 17 pid: 5803 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787764774.994618:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787764774.994633:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff9dfcdab66000/0xdf82b4f42fb37a19 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37a20 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764774.994641:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff9dfcc0031800/0xdf82b4f42fb379ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb379f6 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764774.994642:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced26cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3287:1874607176954624:0@lo:103: 00000100:00100000:0.0:1787764774.994643:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1787764774.994644:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff9dfcdab66000/0xdf82b4f42fb37a19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37a20 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764774.994655:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc5d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+17:3286:x1874607176954496:12345-0@lo:103: 00010000:00010000:1.0:1787764774.994662:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787764774.994669:0:6286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787764774.994670:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff9dfcc0031800/0xdf82b4f42fb379ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb379f6 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764774.994674:0:6286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dfcc92b3a00/0xdf82b4f42fb37a4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37a43 expref: 17 pid: 5803 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764774.994674:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764774.994679:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764774.994684:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764774.994685:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787764774.994688:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff9dfcc0031800/0xdf82b4f42fb379ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb379f6 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764774.994696:0:6286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dfcc92b3a00/0xdf82b4f42fb37a4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf82b4f42fb37a43 expref: 17 pid: 5803 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764774.994709:0:6286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dfcc92b3a00/0xdf82b4f42fb37a4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf82b4f42fb37a43 expref: 17 pid: 5803 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764774.994712:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764774.994714:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced26e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3288:1874607176954240:0@lo:103: 00010000:00010000:1.0:1787764774.994717:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764774.994720:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764774.994731:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764774.994735:0:6286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787764774.994745:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176954624 00000100:00100000:1.0:1787764774.994749:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176954624 00000100:00100000:3.0:1787764774.994762:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787764774.994767:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dfcc0030200/0xdf82b4f42fb37a20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37a19 expref: 17 pid: 5803 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764774.994768:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc5d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+17:3286:x1874607176954496:12345-0@lo:103: Request processed in 113us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764774.994780:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787764774.994798:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3288:1874607176954752:0@lo:103: 00000100:00100000:2.0:1787764774.994812:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176954240 00000100:00100000:2.0:1787764774.994817:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176954240 00000100:00100000:1.0:1787764774.994823:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787764774.994834:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764774.994836:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc668e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+17:3287:x1874607176954624:12345-0@lo:103: 00010000:00010000:2.0:1787764774.994838:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dfcc0030a00/0xdf82b4f42fb37a97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37a90 expref: 17 pid: 5802 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764774.994856:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176954752 00010000:00010000:1.0:1787764774.994857:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787764774.994860:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176954752 00000100:00100000:3.0:1787764774.994862:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1787764774.994865:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dfcc0030200/0xdf82b4f42fb37a20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37a19 expref: 17 pid: 5803 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764774.994867:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787764774.994873:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced26c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3288:1874607176954368:0@lo:103: 00010000:00010000:0.0:1787764774.994875:0:6286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dfcc92b2a00/0xdf82b4f42fb379f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb379ef expref: 18 pid: 5803 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764774.994880:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dfcc0030200/0xdf82b4f42fb37a20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf82b4f42fb37a19 expref: 18 pid: 5803 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764774.994890:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced26f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:3288:x1874607176954240:12345-0@lo:103: 00000100:00100000:3.0:1787764774.994905:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764774.994908:0:6286:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00010000:00010000:2.0:1787764774.994908:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787764774.994909:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dfcc0030200/0xdf82b4f42fb37a20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf82b4f42fb37a19 expref: 18 pid: 5803 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764774.994919:0:6286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:2.0:1787764774.994919:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dfcc0030a00/0xdf82b4f42fb37a97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37a90 expref: 18 pid: 5802 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764774.994933:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dfcc0030a00/0xdf82b4f42fb37a97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf82b4f42fb37a90 expref: 18 pid: 5802 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764774.994944:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced26ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3286:1874607176954496:0@lo:103: 00010000:00010000:2.0:1787764774.994947:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dfcc0030a00/0xdf82b4f42fb37a97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf82b4f42fb37a90 expref: 18 pid: 5802 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764774.994959:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787764774.994995:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced26f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+17:3288:x1874607176954240:12345-0@lo:103: Request processed in 110us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764774.995004:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787764774.995011:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced26e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3288:1874607176954240:0@lo:103: 00000100:00100000:2.0:1787764774.995020:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176954368 00000100:00100000:2.0:1787764774.995025:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176954368 00010000:00010000:2.0:1787764774.995039:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dfcc92b2400/0xdf82b4f42fb37a66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37a5f expref: 17 pid: 5804 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764774.995053:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787764774.995059:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced26cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+17:3288:x1874607176954752:12345-0@lo:103: 00010000:00010000:2.0:1787764774.995067:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787764774.995071:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dfcc92b2a00/0xdf82b4f42fb379f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb379ef expref: 17 pid: 5803 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764774.995097:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dfcc92b2a00/0xdf82b4f42fb379f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf82b4f42fb379ef expref: 17 pid: 5803 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764774.995110:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dfcc92b2a00/0xdf82b4f42fb379f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf82b4f42fb379ef expref: 17 pid: 5803 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764774.995127:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787764774.995156:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787764774.995166:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced26cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+15:3288:x1874607176954752:12345-0@lo:103: Request processed in 106us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764774.995174:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787764774.995193:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787764774.995198:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc668e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:3287:x1874607176954624:12345-0@lo:103: Request processed in 367us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764774.995205:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced26e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:3288:x1874607176954368:12345-0@lo:103: 00000100:00100000:1.0:1787764774.995211:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1787764774.995218:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787764774.995224:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dfcc92b2400/0xdf82b4f42fb37a66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37a5f expref: 13 pid: 5804 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764774.995236:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dfcc92b2400/0xdf82b4f42fb37a66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf82b4f42fb37a5f expref: 13 pid: 5804 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764774.995249:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dfcc92b2400/0xdf82b4f42fb37a66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf82b4f42fb37a5f expref: 13 pid: 5804 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764774.995250:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced26cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3287:1874607176954624:0@lo:103: 00010000:00010000:2.0:1787764774.995271:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dfcc0031200/0xdf82b4f42fb37ab3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764774.995280:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfcc0031200/0xdf82b4f42fb37ab3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764774.995295:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dfcc0031200/0xdf82b4f42fb37ab3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764774.995303:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dfcc0031200/0xdf82b4f42fb37ab3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764774.995310:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dfcc0031200/0xdf82b4f42fb37ab3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764774.995324:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dfcc0031200/0xdf82b4f42fb37ab3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764774.995331:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcc0031200 already unused, calling callback (ffffffffc16cb530) 00010000:00010000:2.0:1787764774.995335:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dfcc0031200/0xdf82b4f42fb37ab3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764774.995344:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dfcc0031200/0xdf82b4f42fb37ab3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764774.995354:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3288:1874607176954752:0@lo:103: 00010000:00010000:2.0:1787764774.995365:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dfcc0031200/0xdf82b4f42fb37ab3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764774.995379:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787764774.995385:0:5804:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dfcc0031200/0xdf82b4f42fb37ab3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764774.995395:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dfcc0031200/0xdf82b4f42fb37ab3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764774.995403:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dfcc0031200/0xdf82b4f42fb37ab3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764774.995413:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced26e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:3288:x1874607176954368:12345-0@lo:103: Request processed in 211us (508us total) trans 0 rc 0/0 20000000:01000000:0.0:1787764774.995419:0:5804:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787764774.995423:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787764774.995428:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced26c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3288:1874607176954368:0@lo:103: 00000100:00100000:0.0:1787764775.014187:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc5d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+11:7596:x1874607176953472:12345-0@lo:253: Request processed in 26362us (26483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764775.014202:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787764775.014227:0:7596:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:7596:1874607176953472:0@lo:253: 10000000:01000000:2.0:1787764775.014246:0:7596:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787764775.014250:0:7596:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787764775.014251:0:7596:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787764775.014253:0:7596:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787764775.014254:0:7596:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1787764775.014255:0:7596:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787764775.014257:0:7596:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787764775.014258:0:7596:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787764775.014260:0:7596:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787764775.014262:0:7596:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787764775.014263:0:7596:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787764775.014295:0:7596:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dfcffb13800 from lustre-OST0001 10000000:01000000:2.0:1787764775.014321:0:7596:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787764775.014335:0:7596:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787764775.014343:0:7596:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9dfcc4e21a48 local copy 10000000:01000000:2.0:1787764775.014348:0:7596:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787764775.014383:0:7596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2400/0xdf82b4f42fb37aba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764775.014394:0:7596:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2400/0xdf82b4f42fb37aba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764775.014403:0:7596:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2400/0xdf82b4f42fb37aba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764775.014421:0:7596:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:7596:1874607176954880:0@lo:101: 00000100:00100000:2.0:1787764775.014462:0:7596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764775.014509:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176954880 00000100:00100000:1.0:1787764775.014516:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176954880 00000100:00100000:2.0:1787764775.014536:0:7596:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc57339c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787764775.014596:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787764775.014605:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+11:7596:x1874607176954880:12345-0@lo:101: 00010000:00010000:1.0:1787764775.014618:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787764775.014631:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dfce1d34800/0xdf82b4f42fb37ac1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb37aba expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764775.014654:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfce1d34800/0xdf82b4f42fb37ac1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb37aba expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764775.014663:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dfce1d34800/0xdf82b4f42fb37ac1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37aba expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764775.014681:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfce1d34800, rc 0) 00000100:00100000:1.0:1787764775.014719:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:7596:x1874607176954880:12345-0@lo:101: Request processed in 115us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764775.014726:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787764775.014754:0:7596:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:7596:1874607176954880:0@lo:101: 00010000:00010000:2.0:1787764775.014768:0:7596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2400/0xdf82b4f42fb37aba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdf82b4f42fb37ac1 expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764775.014779:0:7596:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2400/0xdf82b4f42fb37aba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdf82b4f42fb37ac1 expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764775.014864:0:7596:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:7596:1874607176955008:0@lo:501: 00000100:00100000:2.0:1787764775.014891:0:7596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764775.014914:0:7596:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc57339c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787764775.014936:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176955008 00000100:00100000:0.0:1787764775.014941:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176955008 00000100:00100000:0.0:1787764775.014962:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787764775.014966:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:7596:x1874607176955008:12345-0@lo:501: 00000100:00100000:0.0:1787764775.015269:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:7596:x1874607176955008:12345-0@lo:501: Request processed in 301us (376us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787764775.015279:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787764775.016114:0:7596:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:7596:1874607176955008:0@lo:501: 10000000:01000000:2.0:1787764775.016134:0:7596:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787764775.016174:0:7596:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787764775.016180:0:7596:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2400/0xdf82b4f42fb37aba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdf82b4f42fb37ac1 expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764775.016195:0:7596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2400/0xdf82b4f42fb37aba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdf82b4f42fb37ac1 expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764775.016203:0:7596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2400/0xdf82b4f42fb37aba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdf82b4f42fb37ac1 expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764775.016223:0:7596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787764775.016250:0:7596:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dfcffb13800 00010000:00010000:3.0:1787764775.016251:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1787764775.016256:0:7596:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787764775.016258:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2400/0xdf82b4f42fb37aba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xdf82b4f42fb37ac1 expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787764775.016262:0:7596:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787764775.016267:0:7596:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787764775.016268:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcc92b2400 already unused, calling callback (ffffffffc1cc6c20) 10000000:00010000:3.0:1787764775.016274:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2400/0xdf82b4f42fb37aba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xdf82b4f42fb37ac1 expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787764775.016276:0:7596:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787764775.016281:0:7596:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787764775.016284:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2400/0xdf82b4f42fb37aba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xdf82b4f42fb37ac1 expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787764775.016290:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2400/0xdf82b4f42fb37aba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xdf82b4f42fb37ac1 expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787764775.016295:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787764775.016303:0:7596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2a00/0xdf82b4f42fb37ac8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764775.016312:0:7596:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2a00/0xdf82b4f42fb37ac8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764775.016314:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2400/0xdf82b4f42fb37aba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0xdf82b4f42fb37ac1 expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764775.016326:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787764775.016328:0:7596:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2a00/0xdf82b4f42fb37ac8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764775.016344:0:7596:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:7596:1874607176955136:0@lo:101: 00010000:00010000:3.0:1787764775.016347:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2400/0xdf82b4f42fb37aba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xdf82b4f42fb37ac1 expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764775.016355:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2400/0xdf82b4f42fb37aba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xdf82b4f42fb37ac1 expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764775.016369:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764775.016372:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764775.016375:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764775.016382:0:7596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764775.016404:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced26c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3289:1874607176955264:0@lo:103: 00000100:00100000:3.0:1787764775.016412:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176955136 00000100:00100000:3.0:1787764775.016417:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176955136 00000100:00100000:2.0:1787764775.016419:0:7596:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc5733840 going to sleep for 11 seconds 00000100:00100000:3.0:1787764775.016445:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787764775.016460:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:7596:x1874607176955136:12345-0@lo:101: 00010000:00010000:3.0:1787764775.016467:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1787764775.016472:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787764775.016475:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dfcdab66000/0xdf82b4f42fb37acf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb37ac8 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764775.016502:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfcdab66000/0xdf82b4f42fb37acf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb37ac8 expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764775.016512:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dfcdab66000/0xdf82b4f42fb37acf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37ac8 expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764775.016520:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcdab66000, rc 0) 00000100:00100000:1.0:1787764775.016540:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176955264 00000100:00100000:1.0:1787764775.016547:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176955264 00000100:00100000:3.0:1787764775.016569:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:7596:x1874607176955136:12345-0@lo:101: Request processed in 111us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764775.016576:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787764775.016594:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787764775.016607:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaa48f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+13:3289:x1874607176955264:12345-0@lo:103: 00000100:00100000:2.0:1787764775.016612:0:7596:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:7596:1874607176955136:0@lo:101: 00010000:00010000:1.0:1787764775.016620:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787764775.016626:0:7596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2a00/0xdf82b4f42fb37ac8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37acf expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764775.016639:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dfce1d34800/0xdf82b4f42fb37ac1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdf82b4f42fb37aba expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764775.016654:0:7596:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2a00/0xdf82b4f42fb37ac8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf82b4f42fb37acf expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764775.016659:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787764775.016711:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaa48f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:3289:x1874607176955264:12345-0@lo:103: Request processed in 107us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764775.016720:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787764775.016723:0:7596:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:7596:1874607176955392:0@lo:501: 00000100:00100000:2.0:1787764775.016753:0:7596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764775.016777:0:7596:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc5733840 going to sleep for 11 seconds 00000100:00100000:0.0:1787764775.016809:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced26c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3289:1874607176955264:0@lo:103: 00000100:00100000:1.0:1787764775.016861:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176955392 00000100:00100000:1.0:1787764775.016865:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176955392 00000100:00100000:1.0:1787764775.016941:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787764775.016949:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:7596:x1874607176955392:12345-0@lo:501: 00000100:00100000:1.0:1787764775.017292:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:7596:x1874607176955392:12345-0@lo:501: Request processed in 343us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764775.017299:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787764775.017312:0:7596:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:7596:1874607176955392:0@lo:501: 00000100:00100000:2.0:1787764775.017349:0:7596:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:7596:1874607176955520:0@lo:503: 00000100:00100000:2.0:1787764775.017384:0:7596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764775.017414:0:7596:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc5733840 going to sleep for 11 seconds 00000100:00100000:3.0:1787764775.017424:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176955520 00000100:00100000:3.0:1787764775.017430:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176955520 00000100:00100000:3.0:1787764775.017459:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787764775.017466:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:7596:x1874607176955520:12345-0@lo:503: 00000100:00100000:3.0:1787764775.017638:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:7596:x1874607176955520:12345-0@lo:503: Request processed in 171us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764775.017646:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787764775.017653:0:7596:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:7596:1874607176955520:0@lo:503: 00000040:00080000:2.0:1787764775.017886:0:7596:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787764775.017950:0:7596:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:7596:1874607176955648:0@lo:502: 00000100:00100000:2.0:1787764775.017974:0:7596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764775.017988:0:7596:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc5733840 going to sleep for 11 seconds 00000100:00100000:1.0:1787764775.018012:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176955648 00000100:00100000:1.0:1787764775.018018:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176955648 00000100:00100000:1.0:1787764775.018045:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787764775.018053:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:7596:x1874607176955648:12345-0@lo:502: 00000100:00100000:1.0:1787764775.018211:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:7596:x1874607176955648:12345-0@lo:502: Request processed in 158us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764775.018218:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787764775.018531:0:7596:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:7596:1874607176955648:0@lo:502: 00000040:00080000:2.0:1787764775.018745:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787764775.018791:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787764775.018826:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787764775.018883:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787764775.018920:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787764775.018952:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787764775.018973:0:7596:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:7596:1874607176955776:0@lo:502: 00000100:00100000:2.0:1787764775.019020:0:7596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764775.019048:0:7596:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc5733840 going to sleep for 11 seconds 00000100:00100000:3.0:1787764775.019168:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176955776 00000100:00100000:3.0:1787764775.019173:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176955776 00000100:00100000:3.0:1787764775.019208:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787764775.019215:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:7596:x1874607176955776:12345-0@lo:502: 00000100:00100000:3.0:1787764775.019334:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:7596:x1874607176955776:12345-0@lo:502: Request processed in 119us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764775.019349:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787764775.019428:0:7596:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:7596:1874607176955776:0@lo:502: 00000040:00080000:0.0:1787764775.019532:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787764775.019542:0:7596:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1787764775.020051:0:7606:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787764775.020059:0:7606:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1787764775.020065:0:7606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787764775.020067:0:7606:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787764775.020073:0:7606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787764775.020120:0:7606:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9dfbc11e3490) 00000020:00000080:1.0:1787764775.020143:0:7606:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787764775.020149:0:7606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787764775.020289:0:7606:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dfcffb13800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787764775.020297:0:7606:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787764775.020303:0:7606:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdf82b4f42fb37add 00010000:00010000:1.0:1787764775.023894:0:7606:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1787764775.024313:0:7606:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1787764775.025583:0:7606:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787764775.025786:0:7606:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1787764775.027620:0:7606:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1787764775.028040:0:7606:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787764775.030959:0:7606:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787764775.030972:0:7606:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787764775.030977:0:7606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787764775.030980:0:7606:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787764775.030984:0:7606:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787764775.030987:0:7606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787764775.030989:0:7606:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787764775.030992:0:7606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787764775.030994:0:7606:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787764775.031032:0:7606:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787764775.031035:0:7606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787764775.031036:0:7606:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787764775.031039:0:7606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787764775.031135:0:7596:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1787764775.031175:0:7596:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787764775.031197:0:7596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2a00/0xdf82b4f42fb37ac8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37acf expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764775.031209:0:7596:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2a00/0xdf82b4f42fb37ac8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37acf expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787764775.031222:0:7596:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dfcffb13800 from 1 10000000:01000000:2.0:1787764775.031226:0:7596:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787764775.031259:0:7596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2600/0xdf82b4f42fb37ae4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764775.031273:0:7596:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2600/0xdf82b4f42fb37ae4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764775.031284:0:7596:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2600/0xdf82b4f42fb37ae4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764775.031307:0:7596:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:7596:1874607176955904:0@lo:101: 00000100:00100000:2.0:1787764775.031372:0:7596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764775.031409:0:7596:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc5733600 going to sleep for 11 seconds 00000100:00100000:1.0:1787764775.031419:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176955904 00000100:00100000:1.0:1787764775.031427:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176955904 00000100:00100000:1.0:1787764775.031476:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787764775.031500:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:7596:x1874607176955904:12345-0@lo:101: 00010000:00010000:1.0:1787764775.031513:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787764775.031526:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dfce1d34800/0xdf82b4f42fb37aeb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb37ae4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764775.031552:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfce1d34800/0xdf82b4f42fb37aeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb37ae4 expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764775.031571:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dfce1d34800/0xdf82b4f42fb37aeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37ae4 expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764775.031580:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfce1d34800, rc 0) 00000100:00100000:1.0:1787764775.031622:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+13:7596:x1874607176955904:12345-0@lo:101: Request processed in 137us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764775.031629:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787764775.031659:0:7596:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:7596:1874607176955904:0@lo:101: 00010000:00010000:2.0:1787764775.031674:0:7596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2600/0xdf82b4f42fb37ae4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37aeb expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764775.031684:0:7596:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2600/0xdf82b4f42fb37ae4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf82b4f42fb37aeb expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764775.031751:0:7596:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:7596:1874607176956032:0@lo:501: 00000100:00100000:2.0:1787764775.031783:0:7596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764775.031798:0:7596:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc5733600 going to sleep for 11 seconds 00000100:00100000:2.0:1787764775.031812:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176956032 00000100:00100000:2.0:1787764775.031816:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176956032 00000100:00100000:2.0:1787764775.031843:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787764775.031851:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+13:7596:x1874607176956032:12345-0@lo:501: 00000100:00100000:2.0:1787764775.032037:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+13:7596:x1874607176956032:12345-0@lo:501: Request processed in 187us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764775.032045:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787764775.032076:0:7596:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:7596:1874607176956032:0@lo:501: 00000100:00100000:2.0:1787764775.032125:0:7596:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:7596:1874607176956160:0@lo:503: 00000100:00100000:2.0:1787764775.032161:0:7596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764775.032192:0:7596:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc5733600 going to sleep for 11 seconds 00000100:00100000:1.0:1787764775.032243:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176956160 00000100:00100000:1.0:1787764775.032248:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176956160 00000100:00100000:1.0:1787764775.032311:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787764775.032320:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc3628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+13:7596:x1874607176956160:12345-0@lo:503: 00000100:00100000:1.0:1787764775.032661:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc3628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+13:7596:x1874607176956160:12345-0@lo:503: Request processed in 342us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764775.032667:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787764775.032747:0:7596:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:7596:1874607176956160:0@lo:503: 00000040:00080000:1.0:1787764775.032947:0:7596:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787764775.032994:0:7596:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa92d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:7596:1874607176956288:0@lo:502: 00000100:00100000:1.0:1787764775.033026:0:7596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764775.033110:0:7596:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfce01cbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787764775.033159:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176956288 00000100:00100000:2.0:1787764775.033163:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176956288 00000100:00100000:2.0:1787764775.033190:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787764775.033197:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc3629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+13:7596:x1874607176956288:12345-0@lo:502: 00000100:00100000:2.0:1787764775.033473:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc3629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+13:7596:x1874607176956288:12345-0@lo:502: Request processed in 276us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764775.033481:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787764775.033558:0:7596:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa92d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:7596:1874607176956288:0@lo:502: 00000040:00080000:1.0:1787764775.033880:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787764775.033932:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787764775.033956:0:7596:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa92d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:7596:1874607176956416:0@lo:502: 00000100:00100000:1.0:1787764775.033992:0:7596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764775.034270:0:7596:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcd8fc4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787764775.034525:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176956416 00000100:00100000:3.0:1787764775.034531:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176956416 00000100:00100000:3.0:1787764775.034598:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787764775.034608:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+13:7596:x1874607176956416:12345-0@lo:502: 00000100:00100000:3.0:1787764775.034759:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+13:7596:x1874607176956416:12345-0@lo:502: Request processed in 151us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764775.034767:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787764775.034786:0:7596:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa92d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:7596:1874607176956416:0@lo:502: 00000040:00080000:1.0:1787764775.034875:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787764775.034886:0:7596:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787764775.035832:0:7610:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787764775.035841:0:7610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787764775.035843:0:7610:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787764775.035857:0:7610:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dfcffb13800 00000020:00000080:1.0:1787764775.035860:0:7610:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787764775.035876:0:7610:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787764775.035878:0:7610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787764775.035879:0:7610:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787764775.035882:0:7610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787764775.035929:0:7596:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787764775.035958:0:7596:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787764775.035977:0:7596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2600/0xdf82b4f42fb37ae4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37aeb expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764775.035988:0:7596:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2600/0xdf82b4f42fb37ae4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37aeb expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787764775.036031:0:7596:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787764775.036040:0:7596:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dfcffb13800 10000000:01000000:3.0:1787764775.036044:0:7596:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dfcffb13800 10000000:01000000:3.0:1787764775.036048:0:7596:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787764775.036054:0:7596:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dfcffb13800 from 1 10000000:01000000:3.0:1787764775.036058:0:7596:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787764775.036121:0:7596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67a00/0xdf82b4f42fb37af2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764775.036130:0:7596:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67a00/0xdf82b4f42fb37af2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764775.036140:0:7596:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67a00/0xdf82b4f42fb37af2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764775.036156:0:7596:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced26e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:7596:1874607176956544:0@lo:101: 00000100:00100000:3.0:1787764775.036196:0:7596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764775.036241:0:7596:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc6b36600 going to sleep for 11 seconds 00000100:00100000:0.0:1787764775.036243:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176956544 00000100:00100000:0.0:1787764775.036250:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176956544 00000100:00100000:0.0:1787764775.036299:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787764775.036306:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc3629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+13:7596:x1874607176956544:12345-0@lo:101: 00010000:00010000:0.0:1787764775.036316:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787764775.036329:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dfcc0031200/0xdf82b4f42fb37af9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb37af2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764775.036352:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfcc0031200/0xdf82b4f42fb37af9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb37af2 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764775.036365:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dfcc0031200/0xdf82b4f42fb37af9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37af2 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764775.036374:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcc0031200, rc 0) 00000100:00100000:0.0:1787764775.036434:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc3629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:7596:x1874607176956544:12345-0@lo:101: Request processed in 128us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764775.036443:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787764775.036458:0:7596:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced26e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:7596:1874607176956544:0@lo:101: 00010000:00010000:3.0:1787764775.036474:0:7596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67a00/0xdf82b4f42fb37af2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37af9 expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764775.036498:0:7596:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67a00/0xdf82b4f42fb37af2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf82b4f42fb37af9 expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764775.036567:0:7596:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced26e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:7596:1874607176956672:0@lo:501: 00000100:00100000:3.0:1787764775.036592:0:7596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764775.036613:0:7596:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc6b36600 going to sleep for 11 seconds 00000100:00100000:1.0:1787764775.036629:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176956672 00000100:00100000:1.0:1787764775.036633:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176956672 00000100:00100000:1.0:1787764775.036655:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787764775.036664:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc3628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:7596:x1874607176956672:12345-0@lo:501: 00000100:00100000:1.0:1787764775.037046:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc3628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:7596:x1874607176956672:12345-0@lo:501: Request processed in 383us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764775.037054:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787764775.037078:0:7596:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced26e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:7596:1874607176956672:0@lo:501: 00000100:00100000:3.0:1787764775.037157:0:7596:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced26e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:7596:1874607176956800:0@lo:503: 00000100:00100000:3.0:1787764775.037196:0:7596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764775.037224:0:7596:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc6b36600 going to sleep for 11 seconds 00000100:00100000:2.0:1787764775.037229:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176956800 00000100:00100000:2.0:1787764775.037235:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176956800 00000100:00100000:2.0:1787764775.037265:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787764775.037275:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:7596:x1874607176956800:12345-0@lo:503: 00000100:00100000:2.0:1787764775.037427:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:7596:x1874607176956800:12345-0@lo:503: Request processed in 154us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764775.037434:0:7596:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced26e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:7596:1874607176956800:0@lo:503: 00000100:00100000:2.0:1787764775.037447:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000040:00080000:3.0:1787764775.037682:0:7596:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787764775.037731:0:7596:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced26e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:7596:1874607176956928:0@lo:502: 00000100:00100000:3.0:1787764775.037782:0:7596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764775.037801:0:7596:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc6b36600 going to sleep for 11 seconds 00000100:00100000:1.0:1787764775.037835:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176956928 00000100:00100000:1.0:1787764775.037840:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176956928 00000100:00100000:1.0:1787764775.037868:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787764775.037874:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:7596:x1874607176956928:12345-0@lo:502: 00000100:00100000:1.0:1787764775.038040:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:7596:x1874607176956928:12345-0@lo:502: Request processed in 165us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764775.038046:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787764775.038071:0:7596:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced26e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:7596:1874607176956928:0@lo:502: 00000040:00080000:3.0:1787764775.038320:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787764775.038362:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787764775.038392:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787764775.038431:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787764775.038462:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787764775.038544:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787764775.038578:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787764775.038607:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787764775.038646:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787764775.038676:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787764775.038704:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787764775.038743:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787764775.038802:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787764775.038834:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787764775.038886:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787764775.038918:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787764775.038962:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787764775.039007:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787764775.039040:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787764775.039069:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787764775.039138:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787764775.039172:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787764775.039213:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787764775.039265:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787764775.039297:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1787764775.039326:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1787764775.039367:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1787764775.039398:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1787764775.039426:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1787764775.039465:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1787764775.039711:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1787764775.039747:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1787764775.039836:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1787764775.039949:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1787764775.039981:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1787764775.040021:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1787764775.040052:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1787764775.040098:0:7596:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced26e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:7596:1874607176957056:0@lo:502: 00000100:00100000:3.0:1787764775.040148:0:7596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764775.040183:0:7596:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc6b36600 going to sleep for 11 seconds 00000100:00100000:2.0:1787764775.040191:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176957056 00000100:00100000:2.0:1787764775.040199:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176957056 00000100:00100000:2.0:1787764775.040253:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787764775.040263:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc3628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:7596:x1874607176957056:12345-0@lo:502: 00000100:00100000:2.0:1787764775.040451:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc3628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:7596:x1874607176957056:12345-0@lo:502: Request processed in 190us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764775.040460:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787764775.040479:0:7596:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced26e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:7596:1874607176957056:0@lo:502: 00000040:00080000:3.0:1787764775.040552:0:7596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1787764775.040561:0:7596:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1787764775.041295:0:7611:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787764775.041309:0:7611:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9dfced150000) 00000020:00000080:3.0:1787764775.041327:0:7611:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1787764775.041392:0:7611:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dfcffb13800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787764775.041396:0:7611:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dfcffb13800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787764775.041398:0:7611:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dfcffb13800 3 00010000:00080000:3.0:1787764775.041422:0:7611:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dfbc1c30000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.153@tcp at head 00010000:00010000:3.0:1787764775.043226:0:7611:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1787764775.043406:0:7611:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787764775.043448:0:7611:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787764775.043456:0:7611:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xdf82b4f42fb37b07 00000100:00080000:3.0:1787764775.043464:0:7611:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787764775.043469:0:7611:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dfbc1c30000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:3.0:1787764775.043509:0:7611:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dfced26e940 x1874607176957184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787764775.043528:0:7611:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787764775.043558:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced26e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1874607176957184:0@lo:38: 00000100:00100000:1.0:1787764775.043613:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764775.043686:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176957184 00000100:00100000:1.0:1787764775.043693:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176957184 00000100:00100000:1.0:1787764775.043727:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787764775.043735:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaa92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3285:x1874607176957184:12345-0@lo:38: 00000040:00080000:3.0:1787764775.043748:0:7611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00010000:00080000:1.0:1787764775.043758:0:5810:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 114 last 0 00000020:00000080:1.0:1787764775.043798:0:5810:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xdf82b4f42fb37b0e 00000004:00100000:1.0:1787764775.043813:0:5810:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787764775.043846:0:5810:0:(import.c:65:import_set_state_nolock()) ffff9dfbc1c26000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1787764775.043878:0:7612:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9dfced26ed00 x1874607176957312/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764775.043887:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc6b36480 going to sleep for 0 seconds 00000100:00100000:1.0:1787764775.043900:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaa92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1874607176957184:12345-0@lo:38: Request processed in 163us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764775.043908:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787764775.044092:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787764775.044101:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176957696:0@lo:400: 00010000:00080000:1.0:1787764775.044211:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dfced26e940 x1874607176957184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787764785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764775.044221:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787764775.044227:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1787764775.044233:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787764775.044237:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00100000:3.0:1787764775.044238:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607176957440:0@lo:400: 00000100:00080000:1.0:1787764775.044240:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9dfbc1c30000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1787764775.044247:0:3285:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000f54d5513): req@ffff9dfced26ed00 x1874607176957312/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764775.044262:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced26e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1874607176957184:0@lo:38: 00000100:00100000:1.0:1787764775.044298:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1874607176957568:0@lo:400: 00000100:00100000:2.0:1787764775.045386:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764775.045463:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176957696 00000100:00100000:2.0:1787764775.045475:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176957696 00000100:00100000:2.0:1787764775.045532:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787764775.045543:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc668cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176957696:12345-0@lo:400: 00000100:00100000:3.0:1787764775.047577:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1787764775.047619:0:7596:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 00000100:00100000:3.0:1787764775.047638:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176957440 00000100:00100000:3.0:1787764775.047645:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176957440 10000000:01000000:1.0:1787764775.047663:0:7596:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787764775.047681:0:7596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67a00/0xdf82b4f42fb37af2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37af9 expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764775.047689:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787764775.047703:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced26e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607176957440:12345-0@lo:400: 00010000:00010000:1.0:1787764775.047717:0:7596:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67a00/0xdf82b4f42fb37af2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37af9 expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764775.047756:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced26e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607176957440:12345-0@lo:400: Request processed in 56us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764775.047764:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000004:1.0:1787764775.047781:0:7596:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787764775.047785:0:7596:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787764775.047786:0:7596:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787764775.047788:0:7596:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787764775.047790:0:7596:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787764775.047792:0:7596:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787764775.047794:0:7596:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787764775.047796:0:7596:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787764775.047798:0:7596:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787764775.047800:0:7596:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787764775.047802:0:7596:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787764775.047806:0:7596:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1787764775.047810:0:7596:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787764775.047813:0:7596:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787764775.047816:0:7596:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000100:00100000:3.0:1787764775.047817:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1787764775.047820:0:7596:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787764775.047822:0:7596:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787764775.047824:0:7596:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787764775.047826:0:7596:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787764775.047827:0:7596:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787764775.047829:0:7596:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787764775.047831:0:7596:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787764775.047832:0:7596:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787764775.047854:0:7596:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787764775.047858:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176957568 00000100:00100000:3.0:1787764775.047863:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176957568 00000100:00100000:1.0:1787764775.047870:0:7596:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa912c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:7596:1874607176957824:0@lo:253: 00000100:00100000:3.0:1787764775.047896:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787764775.047906:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced26c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1874607176957568:12345-0@lo:400: 00000100:00100000:1.0:1787764775.047916:0:7596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764775.047952:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176957824 00000100:00100000:3.0:1787764775.047954:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced26c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1874607176957568:12345-0@lo:400: Request processed in 50us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764775.047957:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176957824 00000100:00100000:3.0:1787764775.047976:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787764775.047994:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00010000:00080000:3.0:1787764775.048151:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dfcc668cf00 x1874607176957568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787764791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764775.048159:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc3628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:7596:x1874607176957824:12345-0@lo:253: 00000100:00100000:3.0:1787764775.048173:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1874607176957568:0@lo:400: 00010000:00080000:3.0:1787764775.048205:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dfcc668ed00 x1874607176957440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787764791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764775.048214:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607176957440:0@lo:400: 00000100:00100000:3.0:1787764775.048267:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764775.048287:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc6b36480 going to sleep for 11 seconds 20000000:01000000:1.0:1787764775.048340:0:5804:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787764775.048359:0:5804:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787764775.050202:0:7596:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcd8fc4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787764775.050500:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176957312 00000100:00100000:1.0:1787764775.050509:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176957312 00000100:00100000:1.0:1787764775.050567:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787764775.050579:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced26cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7612:x1874607176957312:12345-0@lo:901: 00000100:00100000:2.0:1787764775.051111:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc668cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176957696:12345-0@lo:400: Request processed in 5570us (5724us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764775.051121:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787764775.051148:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787764775.051154:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787764775.051329:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced26cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7612:x1874607176957312:12345-0@lo:901: Request processed in 752us (3060us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764775.051338:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787764775.051501:0:7612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dfced26ed00 x1874607176957312/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787764791 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764775.051520:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced26ed00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7612:1874607176957312:0@lo:901: 00010000:00080000:0.0:1787764775.051557:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dfcc668f840 x1874607176957696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764775.051575:0:3289:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787764775.051590:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176957696:0@lo:400: 20000000:01000000:0.0:1787764775.071041:0:5804:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787764775.071063:0:5804:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787764775.071094:0:5824:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787764775.071105:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787764775.071133:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dfcdab66400/0xdf82b4f42fb37b15 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764775.071152:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dfcc92b2c00/0xdf82b4f42fb37a58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37a51 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764775.071161:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dfcdab66400/0xdf82b4f42fb37b15 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764775.071192:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dfcc92b2c00/0xdf82b4f42fb37a58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf82b4f42fb37a51 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764775.071202:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dfcc92b2c00/0xdf82b4f42fb37a58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf82b4f42fb37a51 expref: 14 pid: 5802 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764775.071219:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced26ed00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5824:1874607176957952:0@lo:104: 00000100:00100000:3.0:1787764775.071271:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764775.071321:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc893ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787764775.071395:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176957952 00000100:00100000:2.0:1787764775.071403:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176957952 00000100:00100000:2.0:1787764775.071468:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787764775.071476:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced26f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+3:5824:x1874607176957952:12345-0@lo:104: 00010000:00010000:2.0:1787764775.071495:0:6667:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67200/0xdf82b4f42fb37a51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37a58 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764775.071552:0:6667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787764775.071557:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced26f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+3:5824:x1874607176957952:12345-0@lo:104: Request processed in 83us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764775.071563:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1787764775.071573:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787764775.071582:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67200/0xdf82b4f42fb37a51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37a58 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764775.071592:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcdab67200 already unused, calling callback (ffffffffc1cc6c20) 10000000:00010000:1.0:1787764775.071596:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67200/0xdf82b4f42fb37a51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf82b4f42fb37a58 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764775.071605:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67200/0xdf82b4f42fb37a51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf82b4f42fb37a58 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787764775.071614:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67200/0xdf82b4f42fb37a51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf82b4f42fb37a58 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787764775.071621:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1787764775.071642:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced26ed00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5824:1874607176957952:0@lo:104: 00010000:00010000:3.0:1787764775.071660:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dfcdab66400/0xdf82b4f42fb37b15 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764775.071666:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67200/0xdf82b4f42fb37a51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37a58 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764775.071674:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787764775.071693:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67200/0xdf82b4f42fb37a51 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37a58 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764775.071701:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67200/0xdf82b4f42fb37a51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37a58 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764775.071724:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764775.071726:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764775.071728:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787764775.071737:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787764775.071767:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3288:1874607176958080:0@lo:103: 00000100:00100000:1.0:1787764775.071801:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764775.071851:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176958080 00000100:00100000:2.0:1787764775.071860:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176958080 00010000:00010000:2.0:1787764775.071877:0:6286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dfcc92b2c00/0xdf82b4f42fb37a58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37a51 expref: 15 pid: 5802 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764775.071950:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787764775.071957:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaa921c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+15:3288:x1874607176958080:12345-0@lo:103: 00010000:00010000:2.0:1787764775.071965:0:6286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787764775.071969:0:6286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dfcc92b2c00/0xdf82b4f42fb37a58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37a51 expref: 15 pid: 5802 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764775.071975:0:6286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dfcc92b2c00/0xdf82b4f42fb37a58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf82b4f42fb37a51 expref: 15 pid: 5802 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764775.071984:0:6286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dfcc92b2c00/0xdf82b4f42fb37a58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf82b4f42fb37a51 expref: 15 pid: 5802 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764775.071993:0:6286:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dfcdab66400/0xdf82b4f42fb37b15 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764775.071998:0:6286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfcdab66400/0xdf82b4f42fb37b15 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787764775.072006:0:6286:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000908633s 00010000:00010000:2.0:1787764775.072009:0:6286:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dfcdab66400/0xdf82b4f42fb37b15 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764775.072022:0:6286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dfcdab66400/0xdf82b4f42fb37b15 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764775.072038:0:6286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dfcdab66400/0xdf82b4f42fb37b15 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764775.072045:0:6286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dfcdab66400/0xdf82b4f42fb37b15 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764775.072051:0:6286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcdab66400 already unused, calling callback (ffffffffc16cb530) 00010000:00010000:2.0:1787764775.072055:0:6286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dfcdab66400/0xdf82b4f42fb37b15 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764775.072062:0:6286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dfcdab66400/0xdf82b4f42fb37b15 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764775.072102:0:6286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dfcdab66400/0xdf82b4f42fb37b15 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764775.072114:0:5824:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dfcdab66400/0xdf82b4f42fb37b15 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764775.072119:0:6286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787764775.072127:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dfcdab66400/0xdf82b4f42fb37b15 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764775.072135:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dfcdab66400/0xdf82b4f42fb37b15 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764775.072165:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaa921c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:3288:x1874607176958080:12345-0@lo:103: Request processed in 201us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764775.072171:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787764775.072252:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3288:1874607176958080:0@lo:103: 00000100:00100000:0.0:1787764775.082694:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc3628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+13:7596:x1874607176957824:12345-0@lo:253: Request processed in 34682us (34769us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764775.082710:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787764775.082801:0:7596:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa912c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:7596:1874607176957824:0@lo:253: 10000000:01000000:1.0:1787764775.082816:0:7596:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787764775.082819:0:7596:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787764775.082821:0:7596:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787764775.082823:0:7596:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787764775.082824:0:7596:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787764775.082825:0:7596:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787764775.082826:0:7596:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787764775.082828:0:7596:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787764775.082830:0:7596:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787764775.082831:0:7596:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787764775.082833:0:7596:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787764775.082834:0:7596:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787764775.082848:0:7596:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787764775.086247:0:7596:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787764775.086374:0:7596:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787764775.086622:0:7596:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787764775.086862:0:7596:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787764775.087137:0:7596:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:1.0:1787764775.087277:0:7596:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787764775.089373:0:7596:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1787764775.199657:0:7596:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787764775.199665:0:7596:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787764775.199712:0:7596:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787764775.199765:0:7596:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.153@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787764775.199780:0:7596:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787764775.199805:0:7596:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1787764775.383477:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764776.407193:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764777.175233:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787764777.175258:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced26fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176958208:0@lo:13: 00000100:00100000:3.0:1787764777.175330:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764777.175377:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176958208 00000100:00100000:0.0:1787764777.175386:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176958208 00000100:00080000:3.0:1787764777.175427:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787764777.175449:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787764777.175460:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced26f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176958208:12345-0@lo:13: 00002000:00000024:0.0:1787764777.175510:0:6656:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787764777.175558:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced26f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176958208:12345-0@lo:13: Request processed in 101us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764777.175564:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787764777.175621:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfced26fc00 x1874607176958208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764793 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764777.175652:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced26fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176958208:0@lo:13: 00010000:00010000:2.0:1787764777.431225:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787764777.786710:0:7954:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787764778.455233:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764779.479206:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787764780.247456:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3287:1874607176958336:0@lo:400: 00000100:00100000:2.0:1787764780.247471:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1874607176958464:0@lo:400: 00000100:00100000:0.0:1787764780.247706:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa91680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176958720:0@lo:400: 00000100:00100000:1.0:1787764780.247767:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764780.247767:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764780.247816:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787764780.247822:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1874607176958592:0@lo:400: 00000100:00100000:2.0:1787764780.247844:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764780.247940:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1874607176958848:0@lo:400: 00000100:00100000:0.0:1787764780.247961:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764780.247995:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176958720 00000100:00100000:0.0:1787764780.248015:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176958720 00000100:00100000:0.0:1787764780.248057:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787764780.248066:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaa49a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607176958720:12345-0@lo:400: 00000100:00100000:0.0:1787764780.248171:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaa49a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607176958720:12345-0@lo:400: Request processed in 106us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764780.248178:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787764780.248196:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787764780.248220:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcdaa91680 x1874607176958720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764780.248232:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa91680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176958720:0@lo:400: 00000100:00100000:0.0:1787764780.248851:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764780.248919:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176958464 00000100:00100000:3.0:1787764780.248925:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176958464 00000100:00100000:1.0:1787764780.248979:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176958592 00000100:00100000:1.0:1787764780.248984:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176958592 00000100:00100000:2.0:1787764780.249022:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176958336 00000100:00100000:2.0:1787764780.249027:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176958336 00000100:00100000:1.0:1787764780.249035:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176958848 00000100:00100000:1.0:1787764780.249040:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176958848 00000100:00100000:3.0:1787764780.249042:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787764780.249051:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc668c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1874607176958592:12345-0@lo:400: 00000100:00100000:2.0:1787764780.249057:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787764780.249065:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+13:3287:x1874607176958336:12345-0@lo:400: 00000100:00100000:1.0:1787764780.249072:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787764780.249102:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc668d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1874607176958464:12345-0@lo:400: 00000100:00080000:0.0:1787764780.249131:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787764780.249176:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc668c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1874607176958592:12345-0@lo:400: Request processed in 125us (1328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764780.249184:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787764780.249195:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+13:3287:x1874607176958336:12345-0@lo:400: Request processed in 131us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764780.249201:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787764780.249205:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787764780.249207:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc668d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1874607176958464:12345-0@lo:400: Request processed in 127us (1443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764780.249216:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787764780.249221:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3287:1874607176958336:0@lo:400: 00000100:00100000:3.0:1787764780.249222:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaa4a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1874607176958848:12345-0@lo:400: 00010000:00080000:2.0:1787764780.249252:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcdaa903c0 x1874607176958592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787764796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764780.249263:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1874607176958592:0@lo:400: 00000100:00100000:3.0:1787764780.249272:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaa4a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1874607176958848:12345-0@lo:400: Request processed in 52us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764780.249279:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1787764780.249281:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcdaa930c0 x1874607176958464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787764796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787764780.249289:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcdaa92580 x1874607176958848/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787764796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764780.249297:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1874607176958464:0@lo:400: 00000100:00100000:0.0:1787764780.249302:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1874607176958848:0@lo:400: 00010000:00010000:1.0:1787764780.504322:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764781.527245:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764781.870954:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1787764781.871144:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164358784 00000100:00100000:1.0:1787764781.871154:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164358784 00000100:00100000:1.0:1787764781.871198:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 83 00000100:00100000:1.0:1787764781.871207:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2344:x1874607164358784:12345-192.168.202.53@tcp:250: 00010000:00080000:1.0:1787764781.871237:0:5804:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 4e307722-e9dd-4631-8a6a-b36b6b831f0c@192.168.202.53@tcp t0 exp 0000000000000000 cur 120 last 0 00000020:00000080:1.0:1787764781.871265:0:5804:0:(genops.c:1385:class_connect()) connect: client 4e307722-e9dd-4631-8a6a-b36b6b831f0c, cookie 0xdf82b4f42fb37b1c 00000100:00080000:1.0:1787764781.871415:0:5804:0:(import.c:65:import_set_state_nolock()) ffff9dfbc1c20800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787764781.871513:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e307722-e9dd-4631-8a6a-b36b6b831f0c+5:2344:x1874607164358784:12345-192.168.202.53@tcp:250: Request processed in 305us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764781.871521:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 83 00000100:00100000:0.0:1787764781.873567:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1787764781.875130:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164358912 00000100:00100000:2.0:1787764781.875143:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164358912 00000100:00100000:2.0:1787764781.875209:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 84 00000100:00100000:2.0:1787764781.875219:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e307722-e9dd-4631-8a6a-b36b6b831f0c+5:5563:x1874607164358912:12345-192.168.202.53@tcp:101: 00010000:00010000:2.0:1787764781.875236:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764781.875254:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dfcc92b2400/0xdf82b4f42fb37b23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2033f7a1f5725a9d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764781.875284:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfcc92b2400/0xdf82b4f42fb37b23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725a9d expref: 6 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764781.875309:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dfcc92b2400/0xdf82b4f42fb37b23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725a9d expref: 6 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764781.875318:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcc92b2400, rc 0) 00000100:00100000:2.0:1787764781.875378:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e307722-e9dd-4631-8a6a-b36b6b831f0c+6:5563:x1874607164358912:12345-192.168.202.53@tcp:101: Request processed in 161us (1819us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764781.875385:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 84 00000100:00100000:0.0:1787764781.880735:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1787764781.880835:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164359040 00000100:00100000:1.0:1787764781.880856:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164359040 00000100:00100000:1.0:1787764781.880936:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 85 00000100:00100000:1.0:1787764781.880945:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e307722-e9dd-4631-8a6a-b36b6b831f0c+6:5563:x1874607164359040:12345-192.168.202.53@tcp:501: 00000100:00100000:1.0:1787764781.881343:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e307722-e9dd-4631-8a6a-b36b6b831f0c+6:5563:x1874607164359040:12345-192.168.202.53@tcp:501: Request processed in 399us (618us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787764781.881352:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 85 00000100:00100000:3.0:1787764781.886208:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1787764781.886280:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164359168 00000100:00100000:0.0:1787764781.886291:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164359168 00000100:00100000:0.0:1787764781.886350:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 86 00000100:00100000:0.0:1787764781.886361:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e307722-e9dd-4631-8a6a-b36b6b831f0c+6:5563:x1874607164359168:12345-192.168.202.53@tcp:101: 00010000:00010000:0.0:1787764781.886380:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787764781.886400:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dfcc0031e00/0xdf82b4f42fb37b2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2033f7a1f5725aa4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764781.886467:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfcc0031e00/0xdf82b4f42fb37b2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725aa4 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764781.886480:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dfcc0031e00/0xdf82b4f42fb37b2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725aa4 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764781.886490:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcc0031e00, rc 0) 00000100:00100000:0.0:1787764781.886547:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e307722-e9dd-4631-8a6a-b36b6b831f0c+7:5563:x1874607164359168:12345-192.168.202.53@tcp:101: Request processed in 189us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764781.886554:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 86 00000100:00100000:0.0:1787764781.888180:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1787764781.888241:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164359296 00000100:00100000:1.0:1787764781.888249:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164359296 00000100:00100000:1.0:1787764781.888337:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 87 00000100:00100000:1.0:1787764781.888347:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc3629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e307722-e9dd-4631-8a6a-b36b6b831f0c+7:5563:x1874607164359296:12345-192.168.202.53@tcp:501: 00000100:00100000:1.0:1787764781.888716:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc3629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e307722-e9dd-4631-8a6a-b36b6b831f0c+8:5563:x1874607164359296:12345-192.168.202.53@tcp:501: Request processed in 370us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764781.888724:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 87 00000100:00100000:1.0:1787764781.890224:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1787764781.890297:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164359424 00000100:00100000:0.0:1787764781.890305:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164359424 00000100:00100000:0.0:1787764781.890363:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 88 00000100:00100000:0.0:1787764781.890378:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc3629c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e307722-e9dd-4631-8a6a-b36b6b831f0c+8:5563:x1874607164359424:12345-192.168.202.53@tcp:503: 00000100:00100000:0.0:1787764781.890775:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc3629c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e307722-e9dd-4631-8a6a-b36b6b831f0c+8:5563:x1874607164359424:12345-192.168.202.53@tcp:503: Request processed in 402us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764781.890784:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 88 00000100:00100000:3.0:1787764781.902890:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1787764781.903381:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164359552 00000100:00100000:1.0:1787764781.903391:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164359552 00000100:00100000:1.0:1787764781.903455:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 89 00000100:00100000:1.0:1787764781.903465:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e307722-e9dd-4631-8a6a-b36b6b831f0c+8:5582:x1874607164359552:12345-192.168.202.53@tcp:502: 00000100:00100000:1.0:1787764781.903911:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e307722-e9dd-4631-8a6a-b36b6b831f0c+8:5582:x1874607164359552:12345-192.168.202.53@tcp:502: Request processed in 446us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764781.903918:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 89 00000100:00100000:3.0:1787764781.925897:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1787764781.926118:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164359680 00000100:00100000:0.0:1787764781.926126:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164359680 00000100:00100000:0.0:1787764781.926173:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 90 00000100:00100000:0.0:1787764781.926184:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e307722-e9dd-4631-8a6a-b36b6b831f0c+8:5582:x1874607164359680:12345-192.168.202.53@tcp:502: 00000100:00100000:0.0:1787764781.926404:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e307722-e9dd-4631-8a6a-b36b6b831f0c+8:5582:x1874607164359680:12345-192.168.202.53@tcp:502: Request processed in 222us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764781.926410:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 90 00000100:00100000:0.0:1787764781.933967:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1787764781.934208:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164359808 00000100:00100000:2.0:1787764781.934218:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164359808 00000100:00100000:2.0:1787764781.934335:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 91 00000100:00100000:2.0:1787764781.934346:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e307722-e9dd-4631-8a6a-b36b6b831f0c+8:5563:x1874607164359808:12345-192.168.202.53@tcp:101: 00010000:00010000:2.0:1787764781.934374:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764781.934393:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dfcc92b2c00/0xdf82b4f42fb37b31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2033f7a1f5725ace expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764781.934433:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfcc92b2c00/0xdf82b4f42fb37b31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725ace expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764781.934445:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dfcc92b2c00/0xdf82b4f42fb37b31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725ace expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764781.934455:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcc92b2c00, rc 0) 00000100:00100000:2.0:1787764781.934562:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e307722-e9dd-4631-8a6a-b36b6b831f0c+9:5563:x1874607164359808:12345-192.168.202.53@tcp:101: Request processed in 217us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764781.934570:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 91 00000100:00100000:3.0:1787764781.938378:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1787764781.938477:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164359936 00000100:00100000:1.0:1787764781.938488:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164359936 00000100:00100000:1.0:1787764781.938561:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 92 00000100:00100000:1.0:1787764781.938572:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e307722-e9dd-4631-8a6a-b36b6b831f0c+9:5563:x1874607164359936:12345-192.168.202.53@tcp:256: 20000000:01000000:1.0:1787764781.938598:0:5804:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787764781.938623:0:5804:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787764781.938633:0:5804:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787764781.938635:0:5804:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787764781.938638:0:5804:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1787764781.939734:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e307722-e9dd-4631-8a6a-b36b6b831f0c+9:5563:x1874607164359936:12345-192.168.202.53@tcp:256: Request processed in 1159us (1360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764781.939745:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 92 00000100:00100000:2.0:1787764781.942679:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764781.943882:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164360064 00000100:00100000:3.0:1787764781.943894:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164360064 00000100:00100000:3.0:1787764781.943961:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 93 00000100:00100000:3.0:1787764781.943974:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e307722-e9dd-4631-8a6a-b36b6b831f0c+9:5563:x1874607164360064:12345-192.168.202.53@tcp:101: 00010000:00010000:3.0:1787764781.944002:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787764781.944026:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dfcdab67800/0xdf82b4f42fb37b38 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2033f7a1f5725ad5 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764781.944055:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfcdab67800/0xdf82b4f42fb37b38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725ad5 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764781.944068:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dfcdab67800/0xdf82b4f42fb37b38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725ad5 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764781.944078:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcdab67800, rc 0) 00000100:00100000:3.0:1787764781.944180:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:5563:x1874607164360064:12345-192.168.202.53@tcp:101: Request processed in 209us (1523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764781.944188:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 93 00000100:00100000:3.0:1787764781.952772:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1787764781.952850:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164360192 00000100:00100000:0.0:1787764781.952861:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164360192 00000100:00100000:0.0:1787764781.952923:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 94 00000100:00100000:0.0:1787764781.952934:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:5563:x1874607164360192:12345-192.168.202.53@tcp:501: 00000100:00100000:0.0:1787764781.953547:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:5563:x1874607164360192:12345-192.168.202.53@tcp:501: Request processed in 613us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764781.953556:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 94 00000100:00100000:0.0:1787764781.956842:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764781.956901:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164360320 00000100:00100000:3.0:1787764781.956919:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164360320 00000100:00100000:3.0:1787764781.956977:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 95 00000100:00100000:3.0:1787764781.956987:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:5563:x1874607164360320:12345-192.168.202.53@tcp:503: 00000100:00100000:2.0:1787764781.957502:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:5563:x1874607164360320:12345-192.168.202.53@tcp:503: Request processed in 516us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764781.957516:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 95 00000100:00100000:3.0:1787764781.961692:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1787764781.961838:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164360448 00000100:00100000:1.0:1787764781.961849:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164360448 00000100:00100000:1.0:1787764781.961908:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 96 00000100:00100000:1.0:1787764781.961919:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:5587:x1874607164360448:12345-192.168.202.53@tcp:502: 00000100:00100000:1.0:1787764781.962614:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:5587:x1874607164360448:12345-192.168.202.53@tcp:502: Request processed in 694us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764781.962632:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 96 00000100:00100000:3.0:1787764781.965360:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1787764781.968520:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164360576 00000100:00100000:2.0:1787764781.968535:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164360576 00000100:00100000:2.0:1787764781.968602:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 97 00000100:00100000:2.0:1787764781.968613:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:5587:x1874607164360576:12345-192.168.202.53@tcp:502: 00000100:00100000:2.0:1787764781.968878:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:5587:x1874607164360576:12345-192.168.202.53@tcp:502: Request processed in 265us (3525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764781.968887:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 97 00000100:00100000:0.0:1787764781.971216:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1787764781.971337:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164360704 00000100:00100000:1.0:1787764781.971345:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164360704 00000100:00100000:1.0:1787764781.971386:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 4 00000100:00100000:1.0:1787764781.971393:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaa4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2344:x1874607164360704:12345-192.168.202.53@tcp:38: 00010000:00080000:1.0:1787764781.971449:0:5810:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from c035addb-e6b1-4a9c-9554-21f3e0d84883@192.168.202.53@tcp t0 exp 0000000000000000 cur 120 last 0 00000020:00000080:1.0:1787764781.971494:0:5810:0:(genops.c:1385:class_connect()) connect: client c035addb-e6b1-4a9c-9554-21f3e0d84883, cookie 0xdf82b4f42fb37b3f 00000004:00100000:1.0:1787764781.971522:0:5810:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1787764781.971529:0:5810:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1787764781.984971:0:5810:0:(import.c:65:import_set_state_nolock()) ffff9dfbc1c37800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787764781.985063:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaa4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2344:x1874607164360704:12345-192.168.202.53@tcp:38: Request processed in 13667us (13851us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764781.985075:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 4 00000100:00100000:1.0:1787764782.295534:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787764782.295562:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced26c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176958976:0@lo:13: 00000100:00100000:1.0:1787764782.295634:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764782.295713:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176958976 00000100:00100000:0.0:1787764782.295724:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176958976 00000100:00080000:3.0:1787764782.295776:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787764782.295790:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787764782.295808:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaa91e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176958976:12345-0@lo:13: 00002000:00000024:0.0:1787764782.295855:0:6656:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787764782.295906:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaa91e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176958976:12345-0@lo:13: Request processed in 100us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764782.295913:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787764782.295951:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfced26c000 x1874607176958976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764798 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764782.295967:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced26c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176958976:0@lo:13: 00010000:00010000:3.0:1787764782.551185:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764782.986482:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764782.986519:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1787764782.986547:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164360832 00000100:00100000:0.0:1787764782.986556:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164360832 00000100:00100000:2.0:1787764782.986574:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164360960 00000100:00100000:2.0:1787764782.986579:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164360960 00000100:00080000:3.0:1787764782.986611:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787764782.986626:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00100000:0.0:1787764782.986639:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced26fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c035addb-e6b1-4a9c-9554-21f3e0d84883+7:0:x1874607164360832:12345-192.168.202.53@tcp:41: 00000100:00100000:3.0:1787764782.986641:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00100000:3.0:1787764782.986653:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced26da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+7:5563:x1874607164360960:12345-192.168.202.53@tcp:41: 00000004:00000024:0.0:1787764782.986679:0:6455:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000004:00000024:3.0:1787764782.986679:0:5810:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1787764782.986734:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced26da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+7:5563:x1874607164360960:12345-192.168.202.53@tcp:41: Request processed in 85us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764782.986739:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced26fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c035addb-e6b1-4a9c-9554-21f3e0d84883+7:0:x1874607164360832:12345-192.168.202.53@tcp:41: Request processed in 102us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764782.986744:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00100000:0.0:1787764782.986755:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00100000:0.0:1787764782.987645:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1787764782.987700:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164361088 00000100:00100000:2.0:1787764782.987705:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164361088 00000100:00100000:2.0:1787764782.987738:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:2.0:1787764782.987748:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaa483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:5563:x1874607164361088:12345-192.168.202.53@tcp:40: 00000100:00100000:2.0:1787764782.987788:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaa483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:5563:x1874607164361088:12345-192.168.202.53@tcp:40: Request processed in 43us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764782.987796:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:1.0:1787764782.988689:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1787764782.988744:0:6794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164361216 00000100:00100000:2.0:1787764782.988750:0:6794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164361216 00000100:00100000:2.0:1787764782.988787:0:6794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00100000:2.0:1787764782.988798:0:6794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaa90780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2344:x1874607164361216:12345-192.168.202.53@tcp:8: 00000100:00100000:1.0:1787764782.988808:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00010000:00080000:2.0:1787764782.988822:0:6794:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from c035addb-e6b1-4a9c-9554-21f3e0d84883@192.168.202.53@tcp t0 exp 0000000000000000 cur 122 last 0 00000100:00100000:1.0:1787764782.988840:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000020:00000080:2.0:1787764782.988856:0:6794:0:(genops.c:1385:class_connect()) connect: client c035addb-e6b1-4a9c-9554-21f3e0d84883, cookie 0xdf82b4f42fb37b46 00000100:00100000:0.0:1787764782.988866:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164361344 00002000:00100000:2.0:1787764782.988868:0:6794:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c035addb-e6b1-4a9c-9554-21f3e0d84883/ffff9dfbc313d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113976 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787764782.988879:0:6794:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1787764782.988885:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164361344 00000100:00100000:1.0:1787764782.988907:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764782.988924:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164361472 00000100:00100000:3.0:1787764782.988930:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164361472 00000100:00100000:0.0:1787764782.988942:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 98 00000100:00100000:0.0:1787764782.988952:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2347:x1874607164361344:12345-192.168.202.53@tcp:400: 00000100:00100000:3.0:1787764782.988960:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00100000:3.0:1787764782.988968:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaa930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2344:x1874607164361472:12345-192.168.202.53@tcp:8: 00010000:00080000:3.0:1787764782.988987:0:6651:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from c035addb-e6b1-4a9c-9554-21f3e0d84883@192.168.202.53@tcp t0 exp 0000000000000000 cur 122 last 0 00000100:00100000:1.0:1787764782.988994:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164361600 00000100:00100000:1.0:1787764782.988999:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164361600 00000100:00100000:0.0:1787764782.989001:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2347:x1874607164361344:12345-192.168.202.53@tcp:400: Request processed in 48us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764782.989010:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 98 00000020:00000080:3.0:1787764782.989011:0:6651:0:(genops.c:1385:class_connect()) connect: client c035addb-e6b1-4a9c-9554-21f3e0d84883, cookie 0xdf82b4f42fb37b4d 00002000:00100000:3.0:1787764782.989027:0:6651:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c035addb-e6b1-4a9c-9554-21f3e0d84883/ffff9dfbc1c34800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113976 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:1.0:1787764782.989036:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 0 00002000:00100000:3.0:1787764782.989046:0:6651:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:1.0:1787764782.989048:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaa92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:5563:x1874607164361600:12345-192.168.202.53@tcp:33: 00002000:00080000:2.0:1787764782.989377:0:6794:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787764782.989405:0:6794:0:(import.c:65:import_set_state_nolock()) ffff9dfbc313a000 : changing import state from RECOVER to FULL 00002000:00080000:3.0:1787764782.989457:0:6651:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:2.0:1787764782.989469:0:6794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaa90780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2344:x1874607164361216:12345-192.168.202.53@tcp:8: Request processed in 669us (779us total) trans 0 rc 0/0 00000100:00080000:3.0:1787764782.989476:0:6651:0:(import.c:65:import_set_state_nolock()) ffff9dfbc1c36000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787764782.989479:0:6794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00100000:3.0:1787764782.989504:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaa930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2344:x1874607164361472:12345-192.168.202.53@tcp:8: Request processed in 537us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764782.989510:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 6 00000004:00080000:2.0:1787764782.996795:0:5811:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 7646us 00000004:00200000:2.0:1787764783.003301:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787764783.003492:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaa92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:5563:x1874607164361600:12345-192.168.202.53@tcp:33: Request processed in 14443us (14582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764783.003507:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 0 00000100:00100000:0.0:1787764783.074947:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764783.074998:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164361728 00000100:00100000:3.0:1787764783.075006:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164361728 00000100:00100000:3.0:1787764783.075058:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 8 00000100:00100000:3.0:1787764783.075069:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaa48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:5604:x1874607164361728:12345-192.168.202.53@tcp:101: 00010000:00010000:3.0:1787764783.075126:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787764783.075158:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67600/0xdf82b4f42fb37b54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2033f7a1f5725aff expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764783.075212:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab66c00/0xdf82b4f42fb37b5b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764783.075232:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab66c00/0xdf82b4f42fb37b5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764783.075248:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab66c00/0xdf82b4f42fb37b5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787764783.075444:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787764783.075448:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787764783.075504:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab66c00/0xdf82b4f42fb37b5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764783.075525:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67600/0xdf82b4f42fb37b54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725aff expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764783.075543:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab66c00/0xdf82b4f42fb37b5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725aff expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764783.075549:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dfce0e3cb00) 00010000:00010000:3.0:1787764783.075551:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787764783.075553:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcdab66c00, rc 0) 00000100:00100000:3.0:1787764783.075604:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaa48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+7:5604:x1874607164361728:12345-192.168.202.53@tcp:101: Request processed in 538us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764783.075609:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 8 00010000:00010000:1.0:1787764783.575365:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787764784.343223:0:5806:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787764784.343232:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dfcf55aa800 from 30 10000000:01000000:2.0:1787764784.343237:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787764784.343284:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3200/0xdf82b4f42fb37b62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764784.343296:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3200/0xdf82b4f42fb37b62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764784.343309:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3200/0xdf82b4f42fb37b62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764784.343334:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176959104:0@lo:101: 00000100:00100000:2.0:1787764784.343433:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764784.343653:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176959104 00000100:00100000:0.0:1787764784.343662:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176959104 00000100:00100000:2.0:1787764784.343734:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc671dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787764784.343834:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787764784.343843:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+13:5806:x1874607176959104:12345-0@lo:101: 00010000:00010000:0.0:1787764784.343858:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787764784.343871:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dfcc0030800/0xdf82b4f42fb37b69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb37b62 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764784.343905:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfcc0030800/0xdf82b4f42fb37b69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb37b62 expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764784.343916:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dfcc0030800/0xdf82b4f42fb37b69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37b62 expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764784.343926:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcc0030800, rc 0) 00000100:00100000:0.0:1787764784.343980:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:5806:x1874607176959104:12345-0@lo:101: Request processed in 138us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764784.343987:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787764784.344172:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176959104:0@lo:101: 00010000:00010000:2.0:1787764784.344187:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3200/0xdf82b4f42fb37b62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37b69 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764784.344213:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3200/0xdf82b4f42fb37b62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf82b4f42fb37b69 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764784.344263:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176959232:0@lo:501: 00000100:00100000:2.0:1787764784.344288:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764784.344353:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc671dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787764784.344392:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176959232 00000100:00100000:0.0:1787764784.344396:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176959232 00000100:00100000:0.0:1787764784.344445:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787764784.344452:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:5806:x1874607176959232:12345-0@lo:501: 00000100:00100000:0.0:1787764784.344729:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:5806:x1874607176959232:12345-0@lo:501: Request processed in 277us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764784.344736:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787764784.344828:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176959232:0@lo:501: 00000100:00100000:2.0:1787764784.344854:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176959360:0@lo:503: 00000100:00100000:2.0:1787764784.344887:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764784.344904:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc671dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787764784.344945:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176959360 00000100:00100000:0.0:1787764784.344950:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176959360 00000100:00100000:0.0:1787764784.344992:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787764784.345000:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:5806:x1874607176959360:12345-0@lo:503: 00000100:00100000:0.0:1787764784.345194:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:5806:x1874607176959360:12345-0@lo:503: Request processed in 194us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764784.345204:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787764784.345215:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176959360:0@lo:503: 00000100:00100000:1.0:1787764784.345595:0:8175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa903c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8175:1874607176959488:0@lo:502: 00000100:00100000:1.0:1787764784.345620:0:8175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764784.345639:0:8175:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfced8eed80 going to sleep for 11 seconds 00000100:00100000:0.0:1787764784.345666:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176959488 00000100:00100000:0.0:1787764784.345672:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176959488 00000100:00100000:0.0:1787764784.345713:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787764784.345721:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:8175:x1874607176959488:12345-0@lo:502: 00000100:00100000:0.0:1787764784.345925:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:8175:x1874607176959488:12345-0@lo:502: Request processed in 205us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764784.345933:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787764784.345965:0:8175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa903c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8175:1874607176959488:0@lo:502: 00000100:00100000:1.0:1787764784.346004:0:8175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa903c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8175:1874607176959616:0@lo:502: 00000100:00100000:1.0:1787764784.346035:0:8175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764784.346057:0:8175:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfced8eed80 going to sleep for 11 seconds 00000100:00100000:0.0:1787764784.346271:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176959616 00000100:00100000:0.0:1787764784.346276:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176959616 00000100:00100000:0.0:1787764784.346301:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787764784.346309:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:8175:x1874607176959616:12345-0@lo:502: 00000100:00100000:0.0:1787764784.346456:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:8175:x1874607176959616:12345-0@lo:502: Request processed in 148us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764784.346463:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787764784.346535:0:8175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa903c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8175:1874607176959616:0@lo:502: 00000040:00080000:1.0:1787764784.346553:0:8175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787764784.346634:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787764784.346661:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787764784.346670:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3200/0xdf82b4f42fb37b62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37b69 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764784.346680:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3200/0xdf82b4f42fb37b62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37b69 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787764784.346705:0:5806:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787764784.346708:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1787764784.346711:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787764784.346730:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2e00/0xdf82b4f42fb37b70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764784.346739:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2e00/0xdf82b4f42fb37b70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764784.346753:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2e00/0xdf82b4f42fb37b70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764784.346764:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176959744:0@lo:101: 00000100:00100000:2.0:1787764784.346806:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764784.346835:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc671dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787764784.346972:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176959744 00000100:00100000:0.0:1787764784.346981:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176959744 00000100:00100000:0.0:1787764784.347010:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787764784.347015:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:5806:x1874607176959744:12345-0@lo:101: 00010000:00010000:0.0:1787764784.347022:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787764784.347031:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dfcc0030a00/0xdf82b4f42fb37b77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb37b70 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764784.347054:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfcc0030a00/0xdf82b4f42fb37b77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb37b70 expref: 15 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764784.347064:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dfcc0030a00/0xdf82b4f42fb37b77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37b70 expref: 15 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764784.347072:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcc0030a00, rc 0) 00000100:00100000:0.0:1787764784.347122:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+15:5806:x1874607176959744:12345-0@lo:101: Request processed in 107us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764784.347127:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787764784.347258:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176959744:0@lo:101: 00010000:00010000:2.0:1787764784.347269:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2e00/0xdf82b4f42fb37b70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37b77 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764784.347277:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2e00/0xdf82b4f42fb37b70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf82b4f42fb37b77 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764784.347307:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176959872:0@lo:501: 00000100:00100000:2.0:1787764784.347325:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764784.347380:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc671dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787764784.347416:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176959872 00000100:00100000:0.0:1787764784.347419:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176959872 00000100:00100000:0.0:1787764784.347441:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787764784.347445:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+15:5806:x1874607176959872:12345-0@lo:501: 00000100:00100000:0.0:1787764784.347603:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+15:5806:x1874607176959872:12345-0@lo:501: Request processed in 152us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764784.347610:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787764784.347630:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176959872:0@lo:501: 00000100:00100000:2.0:1787764784.347652:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176960000:0@lo:503: 00000100:00100000:2.0:1787764784.347687:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764784.347707:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc671dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787764784.347807:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176960000 00000100:00100000:0.0:1787764784.347811:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176960000 00000100:00100000:0.0:1787764784.347939:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787764784.347947:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+15:5806:x1874607176960000:12345-0@lo:503: 00000100:00100000:0.0:1787764784.348241:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+15:5806:x1874607176960000:12345-0@lo:503: Request processed in 295us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764784.348251:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787764784.348273:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176960000:0@lo:503: 00000100:00100000:0.0:1787764784.348584:0:8176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa4a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8176:1874607176960128:0@lo:502: 00000100:00100000:0.0:1787764784.348620:0:8176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764784.348647:0:8176:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc5cf93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787764784.348739:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176960128 00000100:00100000:1.0:1787764784.348744:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176960128 00000100:00100000:1.0:1787764784.348769:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787764784.348776:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+15:8176:x1874607176960128:12345-0@lo:502: 00000100:00100000:1.0:1787764784.348952:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+15:8176:x1874607176960128:12345-0@lo:502: Request processed in 175us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764784.348958:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787764784.348988:0:8176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa4a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8176:1874607176960128:0@lo:502: 00000020:01000000:0.0:1787764784.349011:0:8176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787764784.349019:0:8176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787764784.349021:0:8176:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787764784.349026:0:8176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787764784.349028:0:8176:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787764784.349043:0:8176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa4a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8176:1874607176960256:0@lo:502: 00000100:00100000:0.0:1787764784.349075:0:8176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764784.349125:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176960256 00000100:00100000:0.0:1787764784.349128:0:8176:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc5cf93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787764784.349130:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176960256 00000100:00100000:2.0:1787764784.349162:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787764784.349170:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+15:8176:x1874607176960256:12345-0@lo:502: 00000100:00100000:2.0:1787764784.349281:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+15:8176:x1874607176960256:12345-0@lo:502: Request processed in 113us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764784.349289:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787764784.349319:0:8176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa4a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8176:1874607176960256:0@lo:502: 00000020:01000000:0.0:1787764784.349338:0:8176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787764784.349342:0:8176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787764784.349344:0:8176:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787764784.349347:0:8176:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1787764784.349419:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1787764784.349443:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787764784.349450:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2e00/0xdf82b4f42fb37b70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37b77 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764784.349460:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2e00/0xdf82b4f42fb37b70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37b77 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787764784.349470:0:5806:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787764784.349472:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dfce623b000 from 30 10000000:01000000:2.0:1787764784.349474:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787764784.349492:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3800/0xdf82b4f42fb37b7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764784.349500:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3800/0xdf82b4f42fb37b7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764784.349508:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3800/0xdf82b4f42fb37b7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764784.349520:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176960384:0@lo:101: 00000100:00100000:2.0:1787764784.349545:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764784.349562:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc671d300 going to sleep for 11 seconds 00000100:00100000:1.0:1787764784.349581:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176960384 00000100:00100000:1.0:1787764784.349586:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176960384 00000100:00100000:1.0:1787764784.349606:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787764784.349611:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+15:5806:x1874607176960384:12345-0@lo:101: 00010000:00010000:1.0:1787764784.349618:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787764784.349627:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dfce1d35400/0xdf82b4f42fb37b85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb37b7e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764784.349643:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfce1d35400/0xdf82b4f42fb37b85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb37b7e expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764784.349650:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dfce1d35400/0xdf82b4f42fb37b85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37b7e expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764784.349656:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfce1d35400, rc 0) 00000100:00100000:1.0:1787764784.349682:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+16:5806:x1874607176960384:12345-0@lo:101: Request processed in 71us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764784.349688:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787764784.349719:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176960384:0@lo:101: 00010000:00010000:2.0:1787764784.349729:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3800/0xdf82b4f42fb37b7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37b85 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764784.349746:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3800/0xdf82b4f42fb37b7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf82b4f42fb37b85 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764784.349781:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176960512:0@lo:501: 00000100:00100000:2.0:1787764784.349811:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764784.349833:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc671d300 going to sleep for 11 seconds 00000100:00100000:0.0:1787764784.349872:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176960512 00000100:00100000:0.0:1787764784.349877:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176960512 00000100:00100000:0.0:1787764784.349905:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787764784.349912:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+16:5806:x1874607176960512:12345-0@lo:501: 00000100:00100000:0.0:1787764784.350113:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+16:5806:x1874607176960512:12345-0@lo:501: Request processed in 199us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764784.350121:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787764784.350123:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176960512:0@lo:501: 00000100:00100000:2.0:1787764784.350152:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176960640:0@lo:503: 00000100:00100000:2.0:1787764784.350177:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764784.350226:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176960640 00000100:00100000:2.0:1787764784.350228:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc671d300 going to sleep for 11 seconds 00000100:00100000:1.0:1787764784.350232:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176960640 00000100:00100000:1.0:1787764784.350268:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787764784.350276:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+16:5806:x1874607176960640:12345-0@lo:503: 00000100:00100000:1.0:1787764784.350399:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+16:5806:x1874607176960640:12345-0@lo:503: Request processed in 124us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764784.350422:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787764784.350448:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176960640:0@lo:503: 00000100:00100000:1.0:1787764784.350677:0:8177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa903c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8177:1874607176960768:0@lo:502: 00000100:00100000:1.0:1787764784.350709:0:8177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764784.350728:0:8177:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcf55b4180 going to sleep for 11 seconds 00000100:00100000:0.0:1787764784.350747:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176960768 00000100:00100000:0.0:1787764784.350752:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176960768 00000100:00100000:0.0:1787764784.350787:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787764784.350795:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+16:8177:x1874607176960768:12345-0@lo:502: 00000100:00100000:0.0:1787764784.350956:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+16:8177:x1874607176960768:12345-0@lo:502: Request processed in 161us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764784.350961:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787764784.350988:0:8177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa903c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8177:1874607176960768:0@lo:502: 00000100:00100000:1.0:1787764784.351019:0:8177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa903c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8177:1874607176960896:0@lo:502: 00000100:00100000:1.0:1787764784.351045:0:8177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764784.351059:0:8177:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcf55b4180 going to sleep for 11 seconds 00000100:00100000:0.0:1787764784.351068:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176960896 00000100:00100000:0.0:1787764784.351071:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176960896 00000100:00100000:0.0:1787764784.351125:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787764784.351132:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+16:8177:x1874607176960896:12345-0@lo:502: 00000100:00100000:0.0:1787764784.351229:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+16:8177:x1874607176960896:12345-0@lo:502: Request processed in 96us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764784.351235:0:8177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa903c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8177:1874607176960896:0@lo:502: 00000100:00100000:0.0:1787764784.351238:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000040:00080000:1.0:1787764784.351254:0:8177:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787764784.351311:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787764784.351336:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787764784.351344:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3800/0xdf82b4f42fb37b7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37b85 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764784.351353:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3800/0xdf82b4f42fb37b7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37b85 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787764784.351361:0:5806:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787764784.351363:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dfce623b000 from 5 10000000:01000000:2.0:1787764784.351365:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787764784.351383:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3600/0xdf82b4f42fb37b8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764784.351390:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3600/0xdf82b4f42fb37b8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764784.351416:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3600/0xdf82b4f42fb37b8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764784.351428:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176961024:0@lo:101: 00000100:00100000:2.0:1787764784.351457:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764784.351480:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc671d300 going to sleep for 11 seconds 00000100:00100000:0.0:1787764784.351499:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176961024 00000100:00100000:0.0:1787764784.351504:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176961024 00000100:00100000:0.0:1787764784.351531:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787764784.351540:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+16:5806:x1874607176961024:12345-0@lo:101: 00010000:00010000:0.0:1787764784.351549:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787764784.351559:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dfcc0031800/0xdf82b4f42fb37b93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb37b8c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764784.351577:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfcc0031800/0xdf82b4f42fb37b93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb37b8c expref: 17 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764784.351588:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dfcc0031800/0xdf82b4f42fb37b93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37b8c expref: 17 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764784.351596:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcc0031800, rc 0) 00000100:00100000:0.0:1787764784.351629:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+17:5806:x1874607176961024:12345-0@lo:101: Request processed in 90us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764784.351641:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787764784.351649:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176961024:0@lo:101: 00010000:00010000:2.0:1787764784.351659:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3600/0xdf82b4f42fb37b8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37b93 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764784.351665:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3600/0xdf82b4f42fb37b8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf82b4f42fb37b93 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764784.351694:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176961152:0@lo:256: 00000100:00100000:2.0:1787764784.351715:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764784.351728:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc671d300 going to sleep for 11 seconds 00000100:00100000:0.0:1787764784.351745:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176961152 00000100:00100000:0.0:1787764784.351750:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176961152 00000100:00100000:0.0:1787764784.351772:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787764784.351838:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+17:5806:x1874607176961152:12345-0@lo:256: 20000000:01000000:0.0:1787764784.351853:0:5804:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787764784.351870:0:5804:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787764784.351873:0:5804:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1787764784.351956:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+17:5806:x1874607176961152:12345-0@lo:256: Request processed in 177us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764784.351964:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787764784.351968:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176961152:0@lo:256: 10000000:01000000:2.0:1787764784.352010:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787764784.352014:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3600/0xdf82b4f42fb37b8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37b93 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764784.352019:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3600/0xdf82b4f42fb37b8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37b93 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787764784.352024:0:5806:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787764784.352025:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1787764784.352030:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787764784.352041:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3400/0xdf82b4f42fb37b9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764784.352045:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3400/0xdf82b4f42fb37b9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764784.352050:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3400/0xdf82b4f42fb37b9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764784.352057:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176961280:0@lo:101: 00000100:00100000:2.0:1787764784.352075:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764784.352127:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176961280 00000100:00100000:2.0:1787764784.352128:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc671d300 going to sleep for 11 seconds 00000100:00100000:0.0:1787764784.352133:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176961280 00000100:00100000:0.0:1787764784.352163:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787764784.352172:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+17:5806:x1874607176961280:12345-0@lo:101: 00010000:00010000:0.0:1787764784.352184:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787764784.352192:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dfcc0030200/0xdf82b4f42fb37ba1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb37b9a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764784.352207:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfcc0030200/0xdf82b4f42fb37ba1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb37b9a expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764784.352216:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dfcc0030200/0xdf82b4f42fb37ba1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37b9a expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764784.352223:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcc0030200, rc 0) 00000100:00100000:0.0:1787764784.352252:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:5806:x1874607176961280:12345-0@lo:101: Request processed in 82us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764784.352266:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176961280:0@lo:101: 00000100:00100000:0.0:1787764784.352268:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00010000:00010000:2.0:1787764784.352281:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3400/0xdf82b4f42fb37b9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37ba1 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764784.352287:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3400/0xdf82b4f42fb37b9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf82b4f42fb37ba1 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764784.352315:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176961408:0@lo:501: 00000100:00100000:2.0:1787764784.352339:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764784.352355:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc671d300 going to sleep for 11 seconds 00000100:00100000:0.0:1787764784.352358:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176961408 00000100:00100000:0.0:1787764784.352363:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176961408 00000100:00100000:0.0:1787764784.352388:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787764784.352396:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:5806:x1874607176961408:12345-0@lo:501: 00000100:00100000:0.0:1787764784.352583:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:5806:x1874607176961408:12345-0@lo:501: Request processed in 188us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764784.352590:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787764784.352613:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176961408:0@lo:501: 00000100:00100000:2.0:1787764784.352636:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176961536:0@lo:503: 00000100:00100000:2.0:1787764784.352672:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764784.352689:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc671d300 going to sleep for 11 seconds 00000100:00100000:0.0:1787764784.352694:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176961536 00000100:00100000:0.0:1787764784.352699:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176961536 00000100:00100000:0.0:1787764784.352723:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787764784.352729:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:5806:x1874607176961536:12345-0@lo:503: 00000100:00100000:0.0:1787764784.353000:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:5806:x1874607176961536:12345-0@lo:503: Request processed in 270us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764784.353006:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787764784.353077:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176961536:0@lo:503: 00000100:00100000:0.0:1787764784.353464:0:8178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa4a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8178:1874607176961664:0@lo:502: 00000100:00100000:0.0:1787764784.353500:0:8178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764784.353525:0:8178:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfce0015240 going to sleep for 11 seconds 00000100:00100000:1.0:1787764784.353537:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176961664 00000100:00100000:1.0:1787764784.353543:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176961664 00000100:00100000:1.0:1787764784.353570:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787764784.353588:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:8178:x1874607176961664:12345-0@lo:502: 00000100:00100000:1.0:1787764784.353828:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:8178:x1874607176961664:12345-0@lo:502: Request processed in 250us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764784.353836:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787764784.353856:0:8178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa4a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8178:1874607176961664:0@lo:502: 00000020:01000000:0.0:1787764784.353882:0:8178:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787764784.353889:0:8178:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787764784.353896:0:8178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787764784.353898:0:8178:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787764784.353903:0:8178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787764784.353906:0:8178:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.153@tcp to nid 0x20000c0a8ca99 (192.168.202.153@tcp) 00000020:01000000:0.0:1787764784.353927:0:8178:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787764784.353935:0:8178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787764784.353949:0:8178:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9dfcc7cd0000) 00000020:00000080:0.0:1787764784.353968:0:8178:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1787764784.353973:0:8178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787764784.354034:0:8178:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787764784.354038:0:8178:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787764784.354043:0:8178:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdf82b4f42fb37baf 00010000:00080000:0.0:1787764784.354071:0:8178:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dfcee884000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.153@tcp at head 00010000:00010000:0.0:1787764784.354274:0:8178:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1787764784.354524:0:8178:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1787764784.354532:0:8178:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787764784.354969:0:8178:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787764784.355179:0:8178:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787764784.355226:0:8178:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1787764784.355282:0:8178:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1787764784.355580:0:8179:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787764784.355585:0:8179:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787764784.355935:0:8178:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787764784.355942:0:8178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787764784.355968:0:8178:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787764784.355982:0:8178:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdf82b4f42fb37bb6 00000100:00080000:0.0:1787764784.355990:0:8178:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787764784.355995:0:8178:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dfcee884000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:0.0:1787764784.356021:0:8178:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dfcdaa4a580 x1874607176961792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787764784.356043:0:8178:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1787764784.356070:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1874607176961792:0@lo:8: 00000020:01000000:0.0:1787764784.356124:0:8178:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787764784.356129:0:8178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787764784.356131:0:8178:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787764784.356135:0:8178:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787764784.356146:0:8178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787764784.356148:0:8178:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787764784.356152:0:8178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787764784.356155:0:8178:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787764784.356174:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764784.356179:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1874607176961920:0@lo:400: 00000100:00100000:0.0:1787764784.356182:0:8178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa492c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8178:1874607176962304:0@lo:502: 00000100:00100000:2.0:1787764784.356193:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607176962048:0@lo:400: 00000100:00100000:1.0:1787764784.356237:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176961792 00000100:00100000:3.0:1787764784.356241:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764784.356245:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176961792 00000100:00100000:0.0:1787764784.356246:0:8178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764784.356247:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176962176:0@lo:400: 00000100:00100000:1.0:1787764784.356282:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787764784.356284:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176962304 00000100:00100000:3.0:1787764784.356286:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787764784.356290:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764784.356291:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176962304 00000100:00100000:1.0:1787764784.356295:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaa903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3285:x1874607176961792:12345-0@lo:8: 00000100:00100000:3.0:1787764784.356298:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607176962432:0@lo:400: 00010000:00080000:1.0:1787764784.356322:0:6653:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 123 last 0 00000100:00100000:0.0:1787764784.356330:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787764784.356330:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764784.356343:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:8178:x1874607176962304:12345-0@lo:502: 00000020:00000080:1.0:1787764784.356353:0:6653:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdf82b4f42fb37bbd 00000100:00100000:2.0:1787764784.356367:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00100000:1.0:1787764784.356369:0:6653:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9dfce818f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113976 ocd_grant: 0 ocd_index: 1 ocd_group 0 00000100:00100000:3.0:1787764784.356371:0:6794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176962176 00002000:00080000:1.0:1787764784.356378:0:6653:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000100:00100000:3.0:1787764784.356378:0:6794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176962176 00000001:00000004:1.0:1787764784.356385:0:6653:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1787764784.356398:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176961920 00000100:00100000:2.0:1787764784.356419:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176961920 00000100:00100000:3.0:1787764784.356450:0:6794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787764784.356458:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176962048 00000100:00100000:2.0:1787764784.356462:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176962048 00000100:00100000:3.0:1787764784.356463:0:6794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc668da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176962176:12345-0@lo:400: 00000100:00100000:2.0:1787764784.356488:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176962432 00000100:00100000:2.0:1787764784.356492:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176962432 00000100:00100000:2.0:1787764784.356521:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00002000:00100000:1.0:1787764784.356524:0:6653:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1787764784.356526:0:6794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc668da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176962176:12345-0@lo:400: Request processed in 64us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764784.356534:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced26c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1874607176961920:12345-0@lo:400: 00000100:00100000:3.0:1787764784.356541:0:6794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787764784.356567:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787764784.356574:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787764784.356578:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced26c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1874607176961920:12345-0@lo:400: Request processed in 46us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764784.356586:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787764784.356608:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787764784.356615:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787764784.356620:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc668f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607176962048:12345-0@lo:400: 00000100:00100000:3.0:1787764784.356630:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc668e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607176962432:12345-0@lo:400: 00000100:00100000:0.0:1787764784.356648:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:8178:x1874607176962304:12345-0@lo:502: Request processed in 306us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764784.356657:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787764784.356667:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc668f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607176962048:12345-0@lo:400: Request processed in 52us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764784.356673:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787764784.356694:0:8178:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc5ddef00 going to sleep for 11 seconds 00000100:00100000:3.0:1787764784.356704:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc668e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607176962432:12345-0@lo:400: Request processed in 78us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764784.356716:0:8178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa492c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8178:1874607176962304:0@lo:502: 00000100:00100000:3.0:1787764784.356722:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000020:01000000:0.0:1787764784.356746:0:8178:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787764784.356751:0:8178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787764784.356753:0:8178:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00002000:00080000:1.0:1787764784.356755:0:6653:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000040:00080000:0.0:1787764784.356758:0:8178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00010000:00080000:3.0:1787764784.356780:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcc668c3c0 x1874607176962176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787764784.356791:0:6653:0:(import.c:65:import_set_state_nolock()) ffff9dfce8188800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787764784.356801:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176962176:0@lo:400: 00000100:00100000:1.0:1787764784.356841:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaa903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3285:x1874607176961792:12345-0@lo:8: Request processed in 548us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764784.356851:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787764784.356851:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607176962432:0@lo:400: 00000100:00100000:3.0:1787764784.356871:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1874607176961920:0@lo:400: 00000100:00100000:3.0:1787764784.356910:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607176962048:0@lo:400: 00010000:00080000:1.0:1787764784.356915:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcdaa4a580 x1874607176961792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787764794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764784.356926:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000020:01000000:3.0:1787764784.356932:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 00000100:00080000:1.0:1787764784.356933:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787764784.356943:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787764784.356949:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787764784.356952:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9dfcee884000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787764784.356958:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00000004:00080000:1.0:1787764784.356967:0:3285:0:(osp_dev.c:1648:osp_import_event()) got connected 00010000:00010000:3.0:1787764784.356968:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3400/0xdf82b4f42fb37b9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37ba1 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764784.356974:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1874607176961792:0@lo:8: 00000004:00080000:0.0:1787764784.356979:0:8179:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00010000:3.0:1787764784.356982:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3400/0xdf82b4f42fb37b9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37ba1 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787764784.356996:0:5806:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787764784.356999:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9dfcc4e21a48 from 1 10000000:01000000:3.0:1787764784.357002:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787764784.357026:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67600/0xdf82b4f42fb37bc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764784.357035:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67600/0xdf82b4f42fb37bc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764784.357044:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67600/0xdf82b4f42fb37bc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787764784.357059:0:8179:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 123372975836ns, next at 0ns, rc = 0 00000100:00100000:3.0:1787764784.357068:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced26ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176962560:0@lo:101: 00000100:00100000:3.0:1787764784.357127:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764784.358545:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc5714c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787764784.360023:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176962560 00000100:00100000:2.0:1787764784.360033:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176962560 00000100:00100000:2.0:1787764784.360095:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787764784.360105:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc5d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:5806:x1874607176962560:12345-0@lo:101: 00010000:00010000:2.0:1787764784.360121:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764784.360137:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dfcc92b2800/0xdf82b4f42fb37bcb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb37bc4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764784.360169:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfcc92b2800/0xdf82b4f42fb37bcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb37bc4 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764784.360184:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dfcc92b2800/0xdf82b4f42fb37bcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37bc4 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764784.360192:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcc92b2800, rc 0) 00000100:00100000:2.0:1787764784.360253:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc5d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:5806:x1874607176962560:12345-0@lo:101: Request processed in 148us (3125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764784.360261:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787764784.360276:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced26ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176962560:0@lo:101: 00010000:00010000:3.0:1787764784.360296:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67600/0xdf82b4f42fb37bc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37bcb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764784.360308:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67600/0xdf82b4f42fb37bc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf82b4f42fb37bcb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764784.360398:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced26ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176962688:0@lo:501: 00000100:00100000:3.0:1787764784.360455:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764784.360494:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc5714c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787764784.360712:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176962688 00000100:00100000:0.0:1787764784.360717:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176962688 00000100:00100000:0.0:1787764784.360749:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787764784.360758:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc5d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:5806:x1874607176962688:12345-0@lo:501: 00000100:00100000:0.0:1787764784.360939:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc5d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:5806:x1874607176962688:12345-0@lo:501: Request processed in 183us (485us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787764784.360948:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787764784.361114:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced26ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176962688:0@lo:501: 10000000:01000000:3.0:1787764784.361152:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787764784.361160:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67600/0xdf82b4f42fb37bc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37bcb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764784.361170:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67600/0xdf82b4f42fb37bc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37bcb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787764784.375998:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:00100000:3.0:1787764784.376030:0:5830:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c035addb-e6b1-4a9c-9554-21f3e0d84883 00000004:00080000:0.0:1787764784.376042:0:8180:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787764784.376066:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176962816:0@lo:13: 00000100:00100000:0.0:1787764784.376072:0:8180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa4a580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8180:1874607176962944:0@lo:7: 00000100:00100000:3.0:1787764784.376188:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764784.376206:0:8180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764784.376550:0:8180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc5dde240 going to sleep for 11 seconds 00000100:00100000:3.0:1787764784.376585:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176962816 00000100:00100000:3.0:1787764784.376593:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176962816 00000100:00080000:0.0:1787764784.376638:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787764784.376660:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787764784.376671:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced26ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1874607176962816:12345-0@lo:13: 00002000:00000024:3.0:1787764784.376692:0:6655:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44367872 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1787764784.376741:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced26ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1874607176962816:12345-0@lo:13: Request processed in 72us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764784.376748:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787764784.376774:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcdaa492c0 x1874607176962816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764784.376782:0:6794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176962944 00000100:00100000:3.0:1787764784.376787:0:6794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176962944 00000100:00100000:0.0:1787764784.376797:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176962816:0@lo:13: 00000100:00100000:3.0:1787764784.376821:0:6794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787764784.376829:0:6794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffb58780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8180:x1874607176962944:12345-0@lo:7: 00002000:00080000:3.0:1787764784.381204:0:6794:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1787764784.381213:0:6794:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787764784.381309:0:6794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffb58780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8180:x1874607176962944:12345-0@lo:7: Request processed in 4475us (5098us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764784.381321:0:6794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787764784.381439:0:8180:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcdaa4a580 x1874607176962944/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787764800 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764784.381456:0:8180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa4a580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8180:1874607176962944:0@lo:7: 00000004:00080000:0.0:1787764784.381473:0:8180:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787764784.381512:0:8180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcffb5ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8180:1874607176963072:0@lo:5: 00000100:00100000:0.0:1787764784.381547:0:8180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764784.381598:0:8180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc5dde240 going to sleep for 11 seconds 00000100:00100000:1.0:1787764784.381638:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176963072 00000100:00100000:1.0:1787764784.381644:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176963072 00000100:00100000:1.0:1787764784.381686:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787764784.381693:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffb58f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8180:x1874607176963072:12345-0@lo:5: 00002000:00080000:1.0:1787764784.381716:0:6653:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787764784.381719:0:6653:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1787764784.381885:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffb58f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8180:x1874607176963072:12345-0@lo:5: Request processed in 193us (338us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787764784.381889:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1787764784.381936:0:8180:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcffb5ad00 x1874607176963072/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787764800 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764784.381945:0:8180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcffb5ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8180:1874607176963072:0@lo:5: 00000004:00080000:0.0:1787764784.381951:0:8180:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787764784.381967:0:8180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcffb5b840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8180:1874607176963200:0@lo:700: 00000100:00100000:0.0:1787764784.381983:0:8180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764784.382003:0:8180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc5dde240 going to sleep for 11 seconds 00000100:00100000:2.0:1787764784.382181:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176963200 00000100:00100000:2.0:1787764784.382184:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176963200 00000100:00100000:2.0:1787764784.382216:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787764784.382224:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffb58b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8180:x1874607176963200:12345-0@lo:700: 00000100:00100000:2.0:1787764784.382251:0:6660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668f840 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6660:1874607176963328:0@lo:700: 00000100:00100000:2.0:1787764784.382283:0:6660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764784.382310:0:6660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc671d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787764784.382334:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176963328 00000100:00100000:3.0:1787764784.382340:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176963328 00000100:00100000:3.0:1787764784.382378:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787764784.382385:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc668ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6660:x1874607176963328:12345-0@lo:700: 40000000:02000000:3.0:1787764784.412124:0:5815:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1787764784.416472:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc668ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6660:x1874607176963328:12345-0@lo:700: Request processed in 34080us (34181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764784.416488:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787764784.416521:0:6660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668f840 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6660:1874607176963328:0@lo:700: 40000000:02000000:2.0:1787764784.416538:0:6660:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:1.0:1787764784.448425:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1787764784.448441:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1787764784.448454:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c035addb-e6b1-4a9c-9554-21f3e0d84883 00000100:00100000:2.0:1787764784.448557:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffb58b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8180:x1874607176963200:12345-0@lo:700: Request processed in 66329us (66566us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764784.448572:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787764784.448596:0:8180:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcffb5b840 x1874607176963200/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787764800 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764784.448610:0:8180:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787764784.448635:0:8180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcffb5b840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8180:1874607176963200:0@lo:700: 00000004:02000040:3.0:1787764784.460380:0:8180:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1787764784.462421:0:8180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced26d2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8180:1874607176963456:0@lo:5: 00000100:00100000:3.0:1787764784.462492:0:8180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764784.462575:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176963456 00000100:00100000:3.0:1787764784.462582:0:8180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfced7f3300 going to sleep for 11 seconds 00000100:00100000:1.0:1787764784.462584:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176963456 00000100:00100000:1.0:1787764784.462694:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787764784.462704:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced26de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8180:x1874607176963456:12345-0@lo:5: 00002000:00080000:0.0:1787764784.466831:0:6651:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1787764784.466850:0:6651:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1787764784.468953:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced26de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8180:x1874607176963456:12345-0@lo:5: Request processed in 6246us (6456us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787764784.468965:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1787764784.469068:0:8180:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfced26d2c0 x1874607176963456/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787764800 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764784.469113:0:8180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced26d2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8180:1874607176963456:0@lo:5: 00000004:00080000:3.0:1787764784.469128:0:8180:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1787764784.599207:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787764785.282982:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764785.283407:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164361856 00000100:00100000:3.0:1787764785.283417:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164361856 00000100:00080000:0.0:1787764785.283490:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787764785.283499:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00100000:3.0:1787764785.283513:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaa91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:5657:x1874607164361856:12345-192.168.202.53@tcp:41: 00000004:00000024:3.0:1787764785.283561:0:5810:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787764785.283625:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaa91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:5657:x1874607164361856:12345-192.168.202.53@tcp:41: Request processed in 117us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764785.283634:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00100000:0.0:1787764785.285307:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1787764785.285354:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164361984 00000100:00100000:1.0:1787764785.285360:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164361984 00000100:00100000:1.0:1787764785.285419:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00080000:0.0:1787764785.285423:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787764785.285428:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffb5b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:5657:x1874607164361984:12345-192.168.202.53@tcp:13: 00002000:00000024:1.0:1787764785.285460:0:6656:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787764785.285508:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffb5b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:5657:x1874607164361984:12345-192.168.202.53@tcp:13: Request processed in 81us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764785.285516:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00100000:0.0:1787764785.286741:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764785.286803:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164362112 00000100:00100000:3.0:1787764785.286811:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164362112 00000100:00100000:3.0:1787764785.286866:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00080000:0.0:1787764785.286869:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787764785.286876:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffb5ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c035addb-e6b1-4a9c-9554-21f3e0d84883+5:5657:x1874607164362112:12345-192.168.202.53@tcp:13: 00002000:00000024:3.0:1787764785.286896:0:6655:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787764785.286949:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffb5ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c035addb-e6b1-4a9c-9554-21f3e0d84883+5:5657:x1874607164362112:12345-192.168.202.53@tcp:13: Request processed in 76us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764785.286970:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 6 00010000:00010000:3.0:1787764785.624245:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787764786.642394:0:8265:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787764786.648249:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787764787.420269:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787764787.425338:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176963584:0@lo:13: 00000100:00100000:0.0:1787764787.425433:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764787.425639:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176963584 00000100:00100000:1.0:1787764787.425647:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176963584 00000100:00100000:1.0:1787764787.425728:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787764787.425738:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffb59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176963584:12345-0@lo:13: 00002000:00000024:1.0:1787764787.425772:0:6656:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787764787.425833:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffb59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176963584:12345-0@lo:13: Request processed in 97us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764787.425841:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787764787.425880:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcc32fc000 x1874607176963584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764803 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764787.425899:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176963584:0@lo:13: 00000100:00080000:0.0:1787764787.425907:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787764787.671290:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787764787.970748:0:6683:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c035addb-e6b1-4a9c-9554-21f3e0d84883 00000100:00100000:0.0:1787764788.228524:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1787764788.228564:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1787764788.228642:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1787764788.228671:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164362368 00000100:00100000:0.0:1787764788.228679:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164362368 00000100:00100000:0.0:1787764788.228738:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 13 00000100:00100000:0.0:1787764788.228748:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffb5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2346:x1874607164362368:12345-192.168.202.53@tcp:400: 00000100:00100000:0.0:1787764788.228814:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffb5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2346:x1874607164362368:12345-192.168.202.53@tcp:400: Request processed in 68us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764788.228821:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 13 00000100:00080000:0.0:1787764788.228839:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787764788.228963:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164362240 00000100:00100000:2.0:1787764788.228967:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164362240 00000100:00100000:2.0:1787764788.229002:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 123 00000100:00100000:2.0:1787764788.229009:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc5d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2346:x1874607164362240:12345-192.168.202.53@tcp:400: 00000100:00100000:2.0:1787764788.229039:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc5d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2346:x1874607164362240:12345-192.168.202.53@tcp:400: Request processed in 31us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764788.229046:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 123 00000100:00100000:3.0:1787764788.229180:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164362496 00000100:00100000:3.0:1787764788.229185:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164362496 00000100:00100000:3.0:1787764788.229215:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 4 00000100:00100000:3.0:1787764788.229277:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffb58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+5:2346:x1874607164362496:12345-192.168.202.53@tcp:400: 00000100:00100000:3.0:1787764788.229310:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffb58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+5:2346:x1874607164362496:12345-192.168.202.53@tcp:400: Request processed in 89us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764788.229317:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 4 00000100:00100000:2.0:1787764788.229505:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764788.229606:0:6794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164362624 00000100:00100000:3.0:1787764788.229610:0:6794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164362624 00000100:00100000:3.0:1787764788.229644:0:6794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00100000:3.0:1787764788.229650:0:6794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc668cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c035addb-e6b1-4a9c-9554-21f3e0d84883+5:2346:x1874607164362624:12345-192.168.202.53@tcp:400: 00000100:00100000:3.0:1787764788.229678:0:6794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc668cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c035addb-e6b1-4a9c-9554-21f3e0d84883+5:2346:x1874607164362624:12345-192.168.202.53@tcp:400: Request processed in 28us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764788.229684:0:6794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00080000:0.0:1787764788.229787:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787764788.229790:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787764788.695217:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764789.464277:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176963712:0@lo:13: 00000100:00100000:3.0:1787764789.464342:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764789.464426:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176963712 00000100:00100000:3.0:1787764789.464433:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176963712 00000100:00100000:3.0:1787764789.464485:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787764789.464494:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc32fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1874607176963712:12345-0@lo:13: 00002000:00000024:3.0:1787764789.464523:0:6656:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787764789.464563:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc32fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1874607176963712:12345-0@lo:13: Request processed in 70us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764789.464570:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787764789.464606:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcc32fe580 x1874607176963712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764789.464623:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176963712:0@lo:13: 00000100:00100000:3.0:1787764789.465837:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3288:1874607176963840:0@lo:400: 00000100:00100000:3.0:1787764789.465882:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764789.465908:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1874607176964352:0@lo:400: 00000100:00100000:3.0:1787764789.465944:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764789.465965:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787764789.465971:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1874607176963968:0@lo:400: 00000100:00100000:3.0:1787764789.465991:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764789.466016:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176963840 00000100:00100000:3.0:1787764789.466020:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176963840 00000100:00100000:3.0:1787764789.466049:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787764789.466055:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc5d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3288:x1874607176963840:12345-0@lo:400: 00000100:00100000:3.0:1787764789.466104:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc5d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3288:x1874607176963840:12345-0@lo:400: Request processed in 48us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764789.466110:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787764789.466134:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176964352 00000100:00100000:3.0:1787764789.466137:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176964352 00000100:00100000:3.0:1787764789.466162:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176963968 00000100:00100000:3.0:1787764789.466164:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176963968 00000100:00100000:3.0:1787764789.466180:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787764789.466187:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcf522e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1874607176964352:12345-0@lo:400: 00000100:00100000:3.0:1787764789.466218:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcf522e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1874607176964352:12345-0@lo:400: Request processed in 31us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764789.466224:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787764789.466235:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787764789.466240:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcf522c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1874607176963968:12345-0@lo:400: 00000100:00100000:0.0:1787764789.466248:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607176964096:0@lo:400: 00000100:00100000:3.0:1787764789.466264:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcf522c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1874607176963968:12345-0@lo:400: Request processed in 23us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764789.466269:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787764789.466314:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1874607176963968:0@lo:400: 00000100:00100000:0.0:1787764789.466317:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764789.466323:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3288:1874607176963840:0@lo:400: 00000100:00100000:3.0:1787764789.466331:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1874607176964352:0@lo:400: 00000100:00100000:0.0:1787764789.466334:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787764789.466339:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176964224:0@lo:400: 00000100:00100000:3.0:1787764789.466349:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176964096 00000100:00100000:3.0:1787764789.466352:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176964096 00000100:00100000:0.0:1787764789.466376:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764789.466387:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787764789.466392:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffb5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607176964096:12345-0@lo:400: 00000100:00080000:0.0:1787764789.466398:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787764789.466402:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787764789.466424:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffb5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607176964096:12345-0@lo:400: Request processed in 32us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764789.466430:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787764789.466445:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176964224 00000100:00100000:3.0:1787764789.466448:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176964224 00000100:00100000:3.0:1787764789.466475:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787764789.466481:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffb583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607176964224:12345-0@lo:400: 00000100:00100000:3.0:1787764789.466512:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffb583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607176964224:12345-0@lo:400: Request processed in 31us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764789.466518:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787764789.466542:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcc32fda40 x1874607176964224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764789.466553:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176964224:0@lo:400: 00000100:00100000:3.0:1787764789.466562:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607176964096:0@lo:400: 00000100:00080000:3.0:1787764789.466578:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1787764789.598288:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1787764789.723587:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787764789.768768:0:8414:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdbe2fea30 20000000:00000080:1.0:1787764789.768792:0:8414:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dfbc2711c00 uarg=0000000000000000 20000000:01000000:1.0:1787764789.768823:0:8414:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1787764789.768826:0:8414:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1787764789.768833:0:8414:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787764789.768838:0:8414:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787764789.768842:0:8414:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1787764789.768855:0:8414:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787764789.768857:0:8414:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787764789.769028:0:8414:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787764789.769031:0:8414:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787764789.773140:0:8415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1787764789.773742:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1787764789.773814:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1787764789.773854:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1787764789.773868:0:8414:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787764789.773877:0:8414:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787764789.775496:0:8416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1787764789.776032:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1787764789.776073:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1787764789.776145:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1787764789.776158:0:8414:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787764789.776161:0:8414:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787764789.777683:0:8417:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1787764789.778389:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1787764789.778469:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1787764789.778508:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1787764789.778522:0:8414:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787764789.778524:0:8414:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787764789.779463:0:8418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1787764789.780146:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1787764789.780209:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1787764789.780247:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:3.0:1787764789.780263:0:8414:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787764789.780282:0:8414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dfcdab66a00/0xdf82b4f42fb37bd2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764789.780299:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dfcdab66000/0xdf82b4f42fb37acf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37ac8 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764789.780307:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dfcc0031200/0xdf82b4f42fb37af9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37af2 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764789.780315:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dfcc92b2400/0xdf82b4f42fb37b23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725a9d expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764789.780323:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dfcc0031e00/0xdf82b4f42fb37b2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725aa4 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764789.780330:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dfcc0030800/0xdf82b4f42fb37b69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37b62 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764789.780336:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dfcc0030a00/0xdf82b4f42fb37b77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37b70 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764789.780343:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dfce1d35400/0xdf82b4f42fb37b85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37b7e expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764789.780368:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dfcc0030200/0xdf82b4f42fb37ba1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37b9a expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764789.780375:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dfcc92b2800/0xdf82b4f42fb37bcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37bc4 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764789.780382:0:8414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dfcdab66a00/0xdf82b4f42fb37bd2 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764789.780417:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dfcc92b2800/0xdf82b4f42fb37bcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf82b4f42fb37bc4 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764789.780431:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dfcc92b2800/0xdf82b4f42fb37bcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf82b4f42fb37bc4 expref: 18 pid: 5804 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764789.780446:0:8414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcf522ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1874607176964480:0@lo:104: 00000100:00100000:3.0:1787764789.780506:0:8414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787764789.780559:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dfcc0030200/0xdf82b4f42fb37ba1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf82b4f42fb37b9a expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764789.780567:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dfcc0030200/0xdf82b4f42fb37ba1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf82b4f42fb37b9a expref: 18 pid: 5803 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764789.780576:0:8414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcf522f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1874607176964608:0@lo:104: 00000100:00100000:3.0:1787764789.780597:0:8414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764789.780613:0:7602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176964480 00000100:00100000:0.0:1787764789.780620:0:7602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176964480 00010000:00010000:3.0:1787764789.780628:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dfce1d35400/0xdf82b4f42fb37b85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf82b4f42fb37b7e expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764789.780638:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dfce1d35400/0xdf82b4f42fb37b85 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf82b4f42fb37b7e expref: 18 pid: 5804 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764789.780655:0:8414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcf522e1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1874607176964736:0@lo:104: 00000100:00100000:0.0:1787764789.780659:0:7602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176964608 00000100:00100000:0.0:1787764789.780663:0:7602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176964608 00000100:00100000:3.0:1787764789.780688:0:8414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764789.780695:0:7602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787764789.780696:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176964736 00000100:00100000:1.0:1787764789.780702:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176964736 00000100:00100000:0.0:1787764789.780708:0:7602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcf522cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+5:8414:x1874607176964480:12345-0@lo:104: 00000100:00100000:3.0:1787764789.780716:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1787764789.780721:0:7602:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67600/0xdf82b4f42fb37bc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37bcb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764789.780726:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787764789.780731:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcf522cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+5:8414:x1874607176964608:12345-0@lo:104: 00000100:00100000:2.0:1787764789.780740:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcee9c2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+5:8414:x1874607176964736:12345-0@lo:104: 00010000:00010000:3.0:1787764789.780742:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3400/0xdf82b4f42fb37b9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37ba1 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764789.780751:0:6667:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3800/0xdf82b4f42fb37b7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37b85 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764789.781689:0:7602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787764789.781697:0:7602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcf522cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+5:8414:x1874607176964480:12345-0@lo:104: Request processed in 993us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764789.781705:0:7602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1787764789.781722:0:6668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787764789.781731:0:6668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67600/0xdf82b4f42fb37bc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37bcb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764789.781741:0:6668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcdab67600 already unused, calling callback (ffffffffc1cc6c20) 10000000:00010000:1.0:1787764789.781745:0:6668:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67600/0xdf82b4f42fb37bc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf82b4f42fb37bcb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764789.781754:0:6668:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67600/0xdf82b4f42fb37bc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf82b4f42fb37bcb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787764789.781761:0:6668:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67600/0xdf82b4f42fb37bc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf82b4f42fb37bcb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787764789.781767:0:6668:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787764789.781961:0:6668:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67600/0xdf82b4f42fb37bc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37bcb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764789.781968:0:6668:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787764789.781988:0:6668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67600/0xdf82b4f42fb37bc4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37bcb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764789.782008:0:6668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67600/0xdf82b4f42fb37bc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37bcb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764789.782019:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764789.782021:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764789.782022:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787764789.782036:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3289:1874607176964864:0@lo:103: 00000100:00100000:1.0:1787764789.782071:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764789.783466:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176964864 00000100:00100000:1.0:1787764789.783472:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176964864 00010000:00010000:1.0:1787764789.783496:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dfcc92b2800/0xdf82b4f42fb37bcb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37bc4 expref: 19 pid: 5804 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764789.783528:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787764789.783536:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc5d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3289:x1874607176964864:12345-0@lo:103: 00010000:00010000:1.0:1787764789.783547:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787764789.783552:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dfcc92b2800/0xdf82b4f42fb37bcb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37bc4 expref: 19 pid: 5804 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764789.783563:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dfcc92b2800/0xdf82b4f42fb37bcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf82b4f42fb37bc4 expref: 19 pid: 5804 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764789.783579:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787764789.783615:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc5d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3289:x1874607176964864:12345-0@lo:103: Request processed in 81us (1543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764789.783622:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787764789.783680:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3289:1874607176964864:0@lo:103: 00010000:00010000:2.0:1787764789.785107:0:6667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787764789.785118:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcee9c2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+4:8414:x1874607176964736:12345-0@lo:104: Request processed in 4380us (4428us total) trans 0 rc 0/0 00010000:00010000:0.0:1787764789.785126:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1787764789.785130:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:0.0:1787764789.785136:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3800/0xdf82b4f42fb37b7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37b85 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764789.785170:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcc92b3800 already unused, calling callback (ffffffffc1cc6c20) 10000000:00010000:0.0:1787764789.785174:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3800/0xdf82b4f42fb37b7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf82b4f42fb37b85 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764789.785181:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3800/0xdf82b4f42fb37b7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf82b4f42fb37b85 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787764789.785188:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3800/0xdf82b4f42fb37b7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf82b4f42fb37b85 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787764789.785194:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787764789.785229:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3800/0xdf82b4f42fb37b7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37b85 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764789.785236:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787764789.785264:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3800/0xdf82b4f42fb37b7e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37b85 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764789.785271:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3800/0xdf82b4f42fb37b7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37b85 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764789.785281:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764789.785283:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764789.785285:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764789.785380:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcffb5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3286:1874607176964992:0@lo:103: 00000100:00100000:2.0:1787764789.785419:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764789.785517:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176964992 00000100:00100000:0.0:1787764789.785522:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176964992 00010000:00010000:0.0:1787764789.785544:0:7603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dfce1d35400/0xdf82b4f42fb37b85 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37b7e expref: 19 pid: 5804 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764789.785569:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787764789.785584:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc668de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3286:x1874607176964992:12345-0@lo:103: 00010000:00010000:0.0:1787764789.785599:0:7603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787764789.785604:0:7603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dfce1d35400/0xdf82b4f42fb37b85 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37b7e expref: 19 pid: 5804 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764789.785614:0:7603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dfce1d35400/0xdf82b4f42fb37b85 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf82b4f42fb37b7e expref: 19 pid: 5804 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764789.785628:0:7603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787764789.785667:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc668de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3286:x1874607176964992:12345-0@lo:103: Request processed in 84us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764789.785673:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1787764789.785797:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787764789.785806:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcf522cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+3:8414:x1874607176964608:12345-0@lo:104: Request processed in 5081us (5208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764789.785814:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1787764789.785851:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787764789.785857:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3400/0xdf82b4f42fb37b9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37ba1 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764789.785865:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcc92b3400 already unused, calling callback (ffffffffc1cc6c20) 10000000:00010000:0.0:1787764789.785867:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3400/0xdf82b4f42fb37b9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf82b4f42fb37ba1 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764789.785874:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3400/0xdf82b4f42fb37b9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf82b4f42fb37ba1 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764789.785879:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dfcc0030a00/0xdf82b4f42fb37b77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf82b4f42fb37b70 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787764789.785882:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3400/0xdf82b4f42fb37b9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf82b4f42fb37ba1 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787764789.785895:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787764789.785898:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dfcc0030a00/0xdf82b4f42fb37b77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf82b4f42fb37b70 expref: 18 pid: 5803 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764789.785909:0:8414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcf522cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1874607176965120:0@lo:104: 00000100:00100000:3.0:1787764789.785936:0:8414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787764789.785955:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3400/0xdf82b4f42fb37b9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37ba1 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764789.785967:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dfcc0030800/0xdf82b4f42fb37b69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf82b4f42fb37b62 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764789.785982:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787764789.785986:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dfcc0030800/0xdf82b4f42fb37b69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf82b4f42fb37b62 expref: 18 pid: 5803 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764789.785999:0:8414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcf522d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1874607176965376:0@lo:104: 00010000:00010000:0.0:1787764789.786003:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3400/0xdf82b4f42fb37b9a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37ba1 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764789.786009:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcffb5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3286:1874607176964992:0@lo:103: 00000100:00100000:3.0:1787764789.786015:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcffb59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3287:1874607176965248:0@lo:103: 00010000:00010000:0.0:1787764789.786018:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3400/0xdf82b4f42fb37b9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37ba1 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764789.786038:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764789.786041:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764789.786043:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764789.786056:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764789.786112:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176965248 00000100:00100000:2.0:1787764789.786117:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176965248 00010000:00010000:2.0:1787764789.786139:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dfcc0030200/0xdf82b4f42fb37ba1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37b9a expref: 19 pid: 5803 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764789.786147:0:8414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787764789.786183:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dfcc0031e00/0xdf82b4f42fb37b2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725aa4 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764789.786196:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1787764789.786198:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dfcc0031e00/0xdf82b4f42fb37b2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725aa4 expref: 9 pid: 5802 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764789.786208:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcf522c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3287:x1874607176965248:12345-0@lo:103: 00000100:00100000:3.0:1787764789.786213:0:8414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcf522e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1874607176965504:192.168.202.53@tcp:104: 00010000:00010000:2.0:1787764789.786219:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787764789.786225:0:7602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176965120 00000100:00100000:0.0:1787764789.786230:0:7602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176965120 00000100:00100000:0.0:1787764789.786255:0:7602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176965376 00000100:00100000:0.0:1787764789.786258:0:7602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176965376 00010000:00010000:3.0:1787764789.786273:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dfcc92b2400/0xdf82b4f42fb37b23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725a9d expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764789.786285:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dfcc92b2400/0xdf82b4f42fb37b23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725a9d expref: 9 pid: 5803 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764789.786287:0:7602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787764789.786299:0:7602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcf522cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+4:8414:x1874607176965120:12345-0@lo:104: 00000100:00100000:3.0:1787764789.786303:0:8414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcf522c3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1874607176965632:192.168.202.53@tcp:104: 00010000:00010000:0.0:1787764789.786312:0:7602:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2e00/0xdf82b4f42fb37b70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37b77 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764789.786322:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787764789.786332:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcf522f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+4:8414:x1874607176965376:12345-0@lo:104: 00010000:00010000:3.0:1787764789.786340:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3200/0xdf82b4f42fb37b62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37b69 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764789.786348:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dfcc0030200/0xdf82b4f42fb37ba1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37b9a expref: 19 pid: 5803 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764789.786361:0:7602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787764789.786369:0:7602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcf522cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+4:8414:x1874607176965120:12345-0@lo:104: Request processed in 72us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764789.786386:0:7602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1787764789.786390:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dfcc0030200/0xdf82b4f42fb37ba1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf82b4f42fb37b9a expref: 19 pid: 5803 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764789.786391:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787764789.786401:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcf522f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+3:8414:x1874607176965376:12345-0@lo:104: Request processed in 71us (257us total) trans 0 rc 0/0 00010000:00010000:2.0:1787764789.786411:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787764789.786411:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1787764789.786431:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787764789.786435:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2e00/0xdf82b4f42fb37b70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37b77 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764789.786452:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcc92b2e00 already unused, calling callback (ffffffffc1cc6c20) 10000000:00010000:3.0:1787764789.786456:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2e00/0xdf82b4f42fb37b70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf82b4f42fb37b77 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764789.786460:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcf522c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3287:x1874607176965248:12345-0@lo:103: Request processed in 254us (401us total) trans 0 rc 0/0 00010000:00010000:3.0:1787764789.786469:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2e00/0xdf82b4f42fb37b70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf82b4f42fb37b77 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764789.786472:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 10000000:00010000:3.0:1787764789.786482:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2e00/0xdf82b4f42fb37b70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf82b4f42fb37b77 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787764789.786488:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787764789.786510:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2e00/0xdf82b4f42fb37b70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37b77 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764789.786516:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787764789.786529:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2e00/0xdf82b4f42fb37b70 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37b77 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764789.786535:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2e00/0xdf82b4f42fb37b70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37b77 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764789.786545:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787764789.786549:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3200/0xdf82b4f42fb37b62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37b69 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764789.786555:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcc92b3200 already unused, calling callback (ffffffffc1cc6c20) 10000000:00010000:3.0:1787764789.786558:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3200/0xdf82b4f42fb37b62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf82b4f42fb37b69 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764789.786565:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcffb59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3287:1874607176965248:0@lo:103: 00010000:00010000:3.0:1787764789.786579:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3200/0xdf82b4f42fb37b62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf82b4f42fb37b69 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787764789.786586:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3200/0xdf82b4f42fb37b62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf82b4f42fb37b69 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787764789.786592:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787764789.786608:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3200/0xdf82b4f42fb37b62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37b69 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764789.786614:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787764789.786619:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3200/0xdf82b4f42fb37b62 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37b69 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764789.786625:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3200/0xdf82b4f42fb37b62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37b69 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764789.786633:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764789.786634:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764789.786636:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764789.786685:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dfcc0031200/0xdf82b4f42fb37af9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf82b4f42fb37af2 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764789.786784:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dfcc0031200/0xdf82b4f42fb37af9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf82b4f42fb37af2 expref: 18 pid: 5802 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764789.786795:0:8414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcf522f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1874607176966016:0@lo:104: 00000100:00100000:3.0:1787764789.786818:0:8414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787764789.786853:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dfcdab66000/0xdf82b4f42fb37acf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf82b4f42fb37ac8 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764789.786863:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dfcdab66000/0xdf82b4f42fb37acf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf82b4f42fb37ac8 expref: 18 pid: 5802 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764789.786869:0:8414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcf522de00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1874607176966144:0@lo:104: 00000100:00100000:3.0:1787764789.786885:0:8414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764789.786901:0:8414:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcd8a47180 going to sleep for 11 seconds 00010000:00010000:3.0:1787764789.786910:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dfcc92b2800/0xdf82b4f42fb37bcb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf82b4f42fb37bc4 expref: 18 pid: 5804 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764789.786916:0:8414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcf522ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1874607176964480:0@lo:104: 00010000:00010000:3.0:1787764789.786922:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dfcc0030200/0xdf82b4f42fb37ba1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf82b4f42fb37b9a expref: 17 pid: 5803 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764789.786927:0:8414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcf522f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1874607176964608:0@lo:104: 00010000:00010000:3.0:1787764789.786932:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dfce1d35400/0xdf82b4f42fb37b85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf82b4f42fb37b7e expref: 16 pid: 5804 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764789.786938:0:8414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcf522e1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1874607176964736:0@lo:104: 00000100:00100000:3.0:1787764789.786942:0:8414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcf522cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1874607176965120:0@lo:104: 00000100:00100000:3.0:1787764789.786945:0:8414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcf522d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1874607176965376:0@lo:104: 00000100:00100000:2.0:1787764789.786973:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176966016 00000100:00100000:2.0:1787764789.786978:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176966016 00000100:00100000:2.0:1787764789.787006:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176966144 00000100:00100000:2.0:1787764789.787010:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176966144 00000100:00100000:2.0:1787764789.787025:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787764789.787031:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcf522d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+4:8414:x1874607176966016:12345-0@lo:104: 00010000:00010000:2.0:1787764789.787039:0:6667:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67a00/0xdf82b4f42fb37af2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37af9 expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764789.787078:0:6667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787764789.787102:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcf522d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+4:8414:x1874607176966016:12345-0@lo:104: Request processed in 71us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764789.787109:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787764789.787127:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787764789.787135:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc32ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+3:8414:x1874607176966144:12345-0@lo:104: 00010000:00010000:2.0:1787764789.787148:0:6667:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2a00/0xdf82b4f42fb37ac8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37acf expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764789.787206:0:6667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787764789.787213:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc32ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+3:8414:x1874607176966144:12345-0@lo:104: Request processed in 79us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764789.787220:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:0.0:1787764789.787249:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787764789.787253:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787764789.787254:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67a00/0xdf82b4f42fb37af2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37af9 expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764789.787260:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2a00/0xdf82b4f42fb37ac8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37acf expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764789.787280:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcdab67a00 already unused, calling callback (ffffffffc1cc6c20) 00010000:00010000:2.0:1787764789.787281:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcc92b2a00 already unused, calling callback (ffffffffc1cc6c20) 10000000:00010000:0.0:1787764789.787284:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67a00/0xdf82b4f42fb37af2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf82b4f42fb37af9 expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787764789.787287:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2a00/0xdf82b4f42fb37ac8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf82b4f42fb37acf expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764789.787292:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67a00/0xdf82b4f42fb37af2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf82b4f42fb37af9 expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787764789.787305:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67a00/0xdf82b4f42fb37af2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf82b4f42fb37af9 expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764789.787305:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2a00/0xdf82b4f42fb37ac8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf82b4f42fb37acf expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787764789.787324:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:2.0:1787764789.787327:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2a00/0xdf82b4f42fb37ac8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf82b4f42fb37acf expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787764789.787335:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787764789.787337:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67a00/0xdf82b4f42fb37af2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37af9 expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764789.787342:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787764789.787362:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67a00/0xdf82b4f42fb37af2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37af9 expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764789.787371:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67a00/0xdf82b4f42fb37af2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37af9 expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764789.787371:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2a00/0xdf82b4f42fb37ac8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37acf expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764789.787382:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787764789.787393:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764789.787393:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2a00/0xdf82b4f42fb37ac8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37acf expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764789.787400:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764789.787403:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2a00/0xdf82b4f42fb37ac8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37acf expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764789.787404:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764789.787416:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3287:1874607176966400:0@lo:103: 00010000:00010000:2.0:1787764789.787426:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764789.787429:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764789.787431:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764789.787444:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcffb59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3286:1874607176966272:0@lo:103: 00000100:00100000:0.0:1787764789.787449:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764789.787484:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764789.787500:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176966400 00000100:00100000:3.0:1787764789.787501:0:8414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcf522f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1874607176966016:0@lo:104: 00000100:00100000:0.0:1787764789.787505:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176966400 00000100:00100000:3.0:1787764789.787517:0:8414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcf522de00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1874607176966144:0@lo:104: 00010000:00010000:0.0:1787764789.787526:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dfcdab66000/0xdf82b4f42fb37acf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37ac8 expref: 16 pid: 5802 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764789.787526:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176966272 00000100:00100000:2.0:1787764789.787531:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176966272 00010000:00010000:2.0:1787764789.787550:0:6286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dfcc0031200/0xdf82b4f42fb37af9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37af2 expref: 17 pid: 5802 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764789.787615:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787764789.787625:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffb5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+17:3287:x1874607176966400:12345-0@lo:103: 00010000:00010000:0.0:1787764789.787633:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787764789.787637:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dfcdab66000/0xdf82b4f42fb37acf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37ac8 expref: 17 pid: 5802 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764789.787645:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dfcdab66000/0xdf82b4f42fb37acf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf82b4f42fb37ac8 expref: 17 pid: 5802 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764789.787655:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dfcdab66000/0xdf82b4f42fb37acf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf82b4f42fb37ac8 expref: 17 pid: 5802 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764789.787664:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787764789.787691:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffb5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+16:3287:x1874607176966400:12345-0@lo:103: Request processed in 70us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764789.787697:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787764789.787709:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787764789.787714:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc668f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+15:3286:x1874607176966272:12345-0@lo:103: 00010000:00010000:0.0:1787764789.787721:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787764789.787724:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dfcc0031200/0xdf82b4f42fb37af9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37af2 expref: 15 pid: 5802 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764789.787732:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dfcc0031200/0xdf82b4f42fb37af9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf82b4f42fb37af2 expref: 15 pid: 5802 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764789.787741:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dfcc0031200/0xdf82b4f42fb37af9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf82b4f42fb37af2 expref: 15 pid: 5802 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764789.787759:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787764789.787785:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc668f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:3286:x1874607176966272:12345-0@lo:103: Request processed in 71us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764789.787791:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787764789.788130:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcffb59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3286:1874607176966272:0@lo:103: 00000100:00100000:0.0:1787764789.788964:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3287:1874607176966400:0@lo:103: 00010000:00010000:2.0:1787764789.789149:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764789.789220:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcf522fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3288:1874607176965760:0@lo:103: 00000100:00100000:0.0:1787764789.789259:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764789.789323:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787764789.789329:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcf522da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3288:1874607176965888:0@lo:103: 00000100:00100000:0.0:1787764789.789373:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764789.789481:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176965760 00000100:00100000:2.0:1787764789.789483:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176965888 00000100:00100000:3.0:1787764789.789488:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176965760 00000100:00100000:2.0:1787764789.789489:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176965888 00010000:00010000:2.0:1787764789.789518:0:6286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dfcc0030800/0xdf82b4f42fb37b69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37b62 expref: 15 pid: 5803 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764789.789519:0:7603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dfcc0030a00/0xdf82b4f42fb37b77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37b70 expref: 15 pid: 5803 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764789.789560:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787764789.789571:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffb59e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+15:3288:x1874607176965888:12345-0@lo:103: 00000100:00100000:3.0:1787764789.789572:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787764789.789586:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffb592c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+15:3288:x1874607176965760:12345-0@lo:103: 00010000:00010000:2.0:1787764789.789587:0:6286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787764789.789595:0:6286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dfcc0030800/0xdf82b4f42fb37b69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37b62 expref: 15 pid: 5803 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764789.789598:0:7603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787764789.789606:0:7603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dfcc0030a00/0xdf82b4f42fb37b77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37b70 expref: 15 pid: 5803 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764789.789609:0:6286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dfcc0030800/0xdf82b4f42fb37b69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf82b4f42fb37b62 expref: 15 pid: 5803 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764789.789631:0:7603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dfcc0030a00/0xdf82b4f42fb37b77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf82b4f42fb37b70 expref: 15 pid: 5803 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764789.789644:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dfcc0030a00/0xdf82b4f42fb37b77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf82b4f42fb37b70 expref: 15 pid: 5803 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764789.789654:0:6286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dfcc0030800/0xdf82b4f42fb37b69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf82b4f42fb37b62 expref: 15 pid: 5803 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764789.789678:0:6286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787764789.789812:0:7603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787764789.790128:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffb59e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+13:3288:x1874607176965888:12345-0@lo:103: Request processed in 559us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764789.790136:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffb592c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+13:3288:x1874607176965760:12345-0@lo:103: Request processed in 552us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764789.790138:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787764789.790157:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787764789.790439:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcf522fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3288:1874607176965760:0@lo:103: 00000100:00100000:1.0:1787764789.790456:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcf522da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3288:1874607176965888:0@lo:103: 00000100:00100000:0.0:1787764789.790603:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1787764789.790649:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164362752 00000100:00100000:2.0:1787764789.790654:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164362752 00000100:00100000:3.0:1787764789.790670:0:8414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcf522e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1874607176965504:192.168.202.53@tcp:104: 00010000:00010000:2.0:1787764789.790676:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dfcc0031e00/0xdf82b4f42fb37b2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725aa4 expref: 10 pid: 5802 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764789.791025:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00100000:2.0:1787764789.791035:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc81e9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2346:x1874607164362752:12345-192.168.202.53@tcp:103: 00010000:00010000:2.0:1787764789.791047:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787764789.791052:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dfcc0031e00/0xdf82b4f42fb37b2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725aa4 expref: 10 pid: 5802 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764789.791063:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dfcc0031e00/0xdf82b4f42fb37b2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725aa4 expref: 10 pid: 5802 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764789.791076:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dfcc0031e00/0xdf82b4f42fb37b2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725aa4 expref: 10 pid: 5802 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764789.791103:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787764789.791146:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc81e9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e307722-e9dd-4631-8a6a-b36b6b831f0c+9:2346:x1874607164362752:12345-192.168.202.53@tcp:103: Request processed in 113us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764789.791153:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00100000:0.0:1787764789.792159:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1787764789.792160:0:8414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcf522c3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1874607176965632:192.168.202.53@tcp:104: 00010000:00010000:1.0:1787764789.792195:0:8414:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dfcdab66a00/0xdf82b4f42fb37bd2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764789.792277:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164362880 00000100:00100000:2.0:1787764789.792283:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164362880 00010000:00010000:2.0:1787764789.792303:0:6286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dfcc92b2400/0xdf82b4f42fb37b23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725a9d expref: 9 pid: 5803 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764789.792367:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 19 00000100:00100000:2.0:1787764789.792377:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffb5a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e307722-e9dd-4631-8a6a-b36b6b831f0c+9:2346:x1874607164362880:12345-192.168.202.53@tcp:103: 00010000:00010000:2.0:1787764789.792387:0:6286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787764789.792392:0:6286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dfcc92b2400/0xdf82b4f42fb37b23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725a9d expref: 9 pid: 5803 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764789.792402:0:6286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dfcc92b2400/0xdf82b4f42fb37b23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725a9d expref: 9 pid: 5803 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764789.792414:0:6286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dfcc92b2400/0xdf82b4f42fb37b23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725a9d expref: 9 pid: 5803 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764789.792426:0:6286:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dfcdab66a00/0xdf82b4f42fb37bd2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764789.792439:0:6286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfcdab66a00/0xdf82b4f42fb37bd2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764789.792452:0:6286:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dfcdab66a00/0xdf82b4f42fb37bd2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764789.792459:0:6286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dfcdab66a00/0xdf82b4f42fb37bd2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764789.792466:0:6286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dfcdab66a00/0xdf82b4f42fb37bd2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764789.792473:0:6286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dfcdab66a00/0xdf82b4f42fb37bd2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764789.792491:0:6286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcdab66a00 already unused, calling callback (ffffffffc16cb530) 00010000:00010000:2.0:1787764789.792495:0:6286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dfcdab66a00/0xdf82b4f42fb37bd2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764789.792503:0:6286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dfcdab66a00/0xdf82b4f42fb37bd2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764789.792525:0:6286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dfcdab66a00/0xdf82b4f42fb37bd2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764789.792538:0:6286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787764789.792541:0:8414:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dfcdab66a00/0xdf82b4f42fb37bd2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764789.792551:0:8414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dfcdab66a00/0xdf82b4f42fb37bd2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764789.792558:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dfcdab66a00/0xdf82b4f42fb37bd2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764789.792573:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffb5a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e307722-e9dd-4631-8a6a-b36b6b831f0c+8:2346:x1874607164362880:12345-192.168.202.53@tcp:103: Request processed in 197us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764789.792582:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 19 00010000:00010000:0.0:1787764790.743709:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764791.044500:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764791.044570:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164363008 00000100:00100000:3.0:1787764791.044580:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164363008 00000100:00100000:3.0:1787764791.044636:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 125 00000100:00100000:3.0:1787764791.044646:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc5d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e307722-e9dd-4631-8a6a-b36b6b831f0c+8:5577:x1874607164363008:12345-192.168.202.53@tcp:101: 00010000:00010000:3.0:1787764791.044663:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787764791.044682:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dfcdab66e00/0xdf82b4f42fb37bd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2033f7a1f5725b06 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764791.044711:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfcdab66e00/0xdf82b4f42fb37bd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b06 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764791.044740:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dfcdab66e00/0xdf82b4f42fb37bd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b06 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764791.044749:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcdab66e00, rc 0) 00000100:00100000:3.0:1787764791.044880:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc5d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e307722-e9dd-4631-8a6a-b36b6b831f0c+9:5577:x1874607164363008:12345-192.168.202.53@tcp:101: Request processed in 231us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764791.044887:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 125 00000100:00100000:0.0:1787764791.045890:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764791.045981:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164363136 00000100:00100000:3.0:1787764791.045987:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164363136 00000100:00100000:3.0:1787764791.046018:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 126 00000100:00100000:3.0:1787764791.046025:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc5d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e307722-e9dd-4631-8a6a-b36b6b831f0c+9:5577:x1874607164363136:12345-192.168.202.53@tcp:501: 00000100:00100000:3.0:1787764791.046326:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc5d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e307722-e9dd-4631-8a6a-b36b6b831f0c+9:5577:x1874607164363136:12345-192.168.202.53@tcp:501: Request processed in 300us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764791.046334:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 126 00000100:00100000:2.0:1787764791.047331:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764791.047382:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164363264 00000100:00100000:3.0:1787764791.047388:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164363264 00000100:00100000:3.0:1787764791.047426:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 127 00000100:00100000:3.0:1787764791.047434:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc5d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e307722-e9dd-4631-8a6a-b36b6b831f0c+9:5577:x1874607164363264:12345-192.168.202.53@tcp:503: 00000100:00100000:3.0:1787764791.047586:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc5d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e307722-e9dd-4631-8a6a-b36b6b831f0c+9:5577:x1874607164363264:12345-192.168.202.53@tcp:503: Request processed in 152us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764791.047594:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 127 00000100:00100000:0.0:1787764791.053276:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764791.054867:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164363392 00000100:00100000:3.0:1787764791.054878:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164363392 00000100:00100000:3.0:1787764791.054943:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 128 00000100:00100000:3.0:1787764791.054953:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e307722-e9dd-4631-8a6a-b36b6b831f0c+9:6051:x1874607164363392:12345-192.168.202.53@tcp:502: 00000100:00100000:3.0:1787764791.055245:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e307722-e9dd-4631-8a6a-b36b6b831f0c+9:6051:x1874607164363392:12345-192.168.202.53@tcp:502: Request processed in 292us (1977us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764791.055253:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 128 00000100:00100000:0.0:1787764791.057671:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764791.057850:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164363520 00000100:00100000:3.0:1787764791.057858:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164363520 00000100:00100000:3.0:1787764791.057907:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 129 00000100:00100000:3.0:1787764791.057924:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e307722-e9dd-4631-8a6a-b36b6b831f0c+9:6051:x1874607164363520:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787764791.058193:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e307722-e9dd-4631-8a6a-b36b6b831f0c+9:6051:x1874607164363520:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 277us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764791.058200:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 129 00000100:00100000:2.0:1787764791.060071:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764791.062518:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164363648 00000100:00100000:3.0:1787764791.062532:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164363648 00000100:00100000:3.0:1787764791.062606:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 130 00000100:00100000:3.0:1787764791.062617:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e307722-e9dd-4631-8a6a-b36b6b831f0c+9:5577:x1874607164363648:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787764791.062632:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787764791.062649:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dfcdab66200/0xdf82b4f42fb37be0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2033f7a1f5725b0d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764791.062675:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfcdab66200/0xdf82b4f42fb37be0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b0d expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764791.062686:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dfcdab66200/0xdf82b4f42fb37be0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b0d expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764791.062694:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcdab66200, rc 0) 00000100:00100000:3.0:1787764791.062759:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:5577:x1874607164363648:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 Request processed in 143us (2691us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764791.063100:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 130 00000100:00100000:1.0:1787764791.065159:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1787764791.065243:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164363776 00000100:00100000:0.0:1787764791.065251:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164363776 00000100:00100000:0.0:1787764791.065296:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 131 00000100:00100000:0.0:1787764791.065304:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:5577:x1874607164363776:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787764791.065563:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:5577:x1874607164363776:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 Request processed in 258us (409us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787764791.065571:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 131 10000000:01000000:2.0:1787764791.383176:0:5806:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787764791.383183:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dfcffb13800 from 39 10000000:01000000:2.0:1787764791.383186:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787764791.383226:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2400/0xdf82b4f42fb37be7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764791.383234:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2400/0xdf82b4f42fb37be7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764791.383242:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2400/0xdf82b4f42fb37be7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764791.383260:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176966528:0@lo:101: 00000100:00100000:2.0:1787764791.383349:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764791.383409:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc7e9ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1787764791.383424:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176966528 00000100:00100000:0.0:1787764791.383439:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176966528 00000100:00100000:0.0:1787764791.383495:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787764791.383505:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+12:5806:x1874607176966528:12345-0@lo:101: 00010000:00010000:0.0:1787764791.383518:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787764791.383531:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dfcc0031c00/0xdf82b4f42fb37bee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb37be7 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764791.383553:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfcc0031c00/0xdf82b4f42fb37bee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb37be7 expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764791.383566:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dfcc0031c00/0xdf82b4f42fb37bee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37be7 expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764791.383575:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcc0031c00, rc 0) 00000100:00100000:0.0:1787764791.383624:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+13:5806:x1874607176966528:12345-0@lo:101: Request processed in 121us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764791.383631:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787764791.384212:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176966528:0@lo:101: 00010000:00010000:2.0:1787764791.384225:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2400/0xdf82b4f42fb37be7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37bee expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764791.384233:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2400/0xdf82b4f42fb37be7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf82b4f42fb37bee expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764791.384282:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176966656:0@lo:501: 00000100:00100000:2.0:1787764791.384303:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764791.384324:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc7e9ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1787764791.384364:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176966656 00000100:00100000:3.0:1787764791.384369:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176966656 00000100:00100000:3.0:1787764791.384404:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787764791.384412:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+13:5806:x1874607176966656:12345-0@lo:501: 00000100:00100000:3.0:1787764791.384631:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+13:5806:x1874607176966656:12345-0@lo:501: Request processed in 219us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764791.384639:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787764791.384664:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176966656:0@lo:501: 00000100:00100000:2.0:1787764791.384692:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176966784:0@lo:503: 00000100:00100000:2.0:1787764791.384731:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764791.384751:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc7e9ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1787764791.384776:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176966784 00000100:00100000:0.0:1787764791.384781:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176966784 00000100:00100000:0.0:1787764791.384811:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787764791.384818:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+13:5806:x1874607176966784:12345-0@lo:503: 00000100:00100000:0.0:1787764791.384950:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+13:5806:x1874607176966784:12345-0@lo:503: Request processed in 133us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764791.384955:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787764791.384980:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176966784:0@lo:503: 00000100:00100000:3.0:1787764791.385235:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fda40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8431:1874607176966912:0@lo:502: 00000100:00100000:3.0:1787764791.385260:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764791.385286:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcd8a470c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787764791.385302:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176966912 00000100:00100000:0.0:1787764791.385306:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176966912 00000100:00100000:0.0:1787764791.385329:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787764791.385335:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+13:8431:x1874607176966912:12345-0@lo:502: 00000100:00100000:0.0:1787764791.385477:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+13:8431:x1874607176966912:12345-0@lo:502: Request processed in 141us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764791.385489:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787764791.385560:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fda40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8431:1874607176966912:0@lo:502: 00000100:00100000:3.0:1787764791.385599:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fda40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8431:1874607176967040:0@lo:502: 00000100:00100000:3.0:1787764791.385632:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764791.385654:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcd8a470c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787764791.385686:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176967040 00000100:00100000:2.0:1787764791.385692:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176967040 00000100:00100000:2.0:1787764791.385721:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787764791.385728:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+13:8431:x1874607176967040:12345-0@lo:502: 00000100:00100000:2.0:1787764791.385880:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+13:8431:x1874607176967040:12345-0@lo:502: Request processed in 152us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764791.385887:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787764791.385959:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fda40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8431:1874607176967040:0@lo:502: 00000040:00080000:3.0:1787764791.385980:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787764791.386155:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787764791.386171:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787764791.386185:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2400/0xdf82b4f42fb37be7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37bee expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764791.386195:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2400/0xdf82b4f42fb37be7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37bee expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787764791.386204:0:5806:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1787764791.386206:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1787764791.386209:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787764791.386230:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2800/0xdf82b4f42fb37bf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764791.386239:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2800/0xdf82b4f42fb37bf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764791.386257:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2800/0xdf82b4f42fb37bf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764791.386269:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176967168:0@lo:101: 00000100:00100000:2.0:1787764791.386297:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764791.386323:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc7e9a180 going to sleep for 11 seconds 00000100:00100000:0.0:1787764791.386360:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176967168 00000100:00100000:0.0:1787764791.386365:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176967168 00000100:00100000:0.0:1787764791.386402:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787764791.386410:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc3628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+13:5806:x1874607176967168:12345-0@lo:101: 00010000:00010000:0.0:1787764791.386420:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787764791.386431:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dfcc0030e00/0xdf82b4f42fb37bfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb37bf5 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764791.386452:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfcc0030e00/0xdf82b4f42fb37bfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb37bf5 expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764791.386463:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dfcc0030e00/0xdf82b4f42fb37bfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37bf5 expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764791.386471:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcc0030e00, rc 0) 00000100:00100000:0.0:1787764791.386510:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc3628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:5806:x1874607176967168:12345-0@lo:101: Request processed in 102us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764791.386517:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787764791.386541:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176967168:0@lo:101: 00010000:00010000:2.0:1787764791.386555:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2800/0xdf82b4f42fb37bf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37bfc expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764791.386564:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2800/0xdf82b4f42fb37bf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf82b4f42fb37bfc expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764791.386602:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176967296:0@lo:501: 00000100:00100000:2.0:1787764791.386637:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764791.386692:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc7e9a180 going to sleep for 11 seconds 00000100:00100000:3.0:1787764791.386730:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176967296 00000100:00100000:3.0:1787764791.386734:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176967296 00000100:00100000:3.0:1787764791.386761:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787764791.386768:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc3629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:5806:x1874607176967296:12345-0@lo:501: 00000100:00100000:3.0:1787764791.386970:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc3629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:5806:x1874607176967296:12345-0@lo:501: Request processed in 201us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764791.386978:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787764791.387005:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176967296:0@lo:501: 00000100:00100000:2.0:1787764791.387031:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176967424:0@lo:503: 00000100:00100000:2.0:1787764791.387065:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764791.387114:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176967424 00000100:00100000:2.0:1787764791.387120:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc7e9a180 going to sleep for 11 seconds 00000100:00100000:0.0:1787764791.387121:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176967424 00000100:00100000:0.0:1787764791.387165:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787764791.387174:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:5806:x1874607176967424:12345-0@lo:503: 00000100:00100000:0.0:1787764791.387304:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:5806:x1874607176967424:12345-0@lo:503: Request processed in 130us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764791.387311:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787764791.387355:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176967424:0@lo:503: 00000100:00100000:2.0:1787764791.387653:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8432:1874607176967552:0@lo:502: 00000100:00100000:2.0:1787764791.387687:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764791.387704:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc7e9ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1787764791.387724:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176967552 00000100:00100000:3.0:1787764791.387734:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176967552 00000100:00100000:3.0:1787764791.387762:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787764791.387769:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc3629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:8432:x1874607176967552:12345-0@lo:502: 00000100:00100000:3.0:1787764791.387892:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc3629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:8432:x1874607176967552:12345-0@lo:502: Request processed in 123us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764791.387899:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787764791.387935:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8432:1874607176967552:0@lo:502: 00000020:01000000:2.0:1787764791.387955:0:8432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787764791.387963:0:8432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787764791.387965:0:8432:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787764791.387969:0:8432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787764791.387994:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8432:1874607176967680:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787764791.388025:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764791.388045:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc7e9ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1787764791.388072:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176967680 00000100:00100000:0.0:1787764791.388078:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176967680 00000100:00100000:0.0:1787764791.388139:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787764791.388147:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc3628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:8432:x1874607176967680:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787764791.388280:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc3628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:8432:x1874607176967680:12345-0@lo:502:llog_process_th.0 Request processed in 133us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764791.388297:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787764791.388450:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8432:1874607176967680:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787764791.388480:0:8432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787764791.388485:0:8432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787764791.388487:0:8432:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787764791.388490:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1787764791.388792:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1787764791.388810:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787764791.388819:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2800/0xdf82b4f42fb37bf5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37bfc expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764791.388843:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2800/0xdf82b4f42fb37bf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37bfc expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787764791.388852:0:5806:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787764791.388854:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dfcf55aa800 from 39 10000000:01000000:1.0:1787764791.388857:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787764791.388877:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfce1d34400/0xdf82b4f42fb37c03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764791.388891:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff9dfce1d34400/0xdf82b4f42fb37c03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764791.388899:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff9dfce1d34400/0xdf82b4f42fb37c03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764791.388913:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa912c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176967808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787764791.388941:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764791.388973:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfced8eb540 going to sleep for 11 seconds 00000100:00100000:3.0:1787764791.389686:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176967808 00000100:00100000:3.0:1787764791.389693:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176967808 00000100:00100000:3.0:1787764791.389728:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787764791.389736:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+14:5806:x1874607176967808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787764791.389747:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787764791.389759:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dfcdab67c00/0xdf82b4f42fb37c0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb37c03 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764791.389780:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfcdab67c00/0xdf82b4f42fb37c0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb37c03 expref: 15 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764791.389790:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dfcdab67c00/0xdf82b4f42fb37c0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37c03 expref: 15 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764791.389799:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcdab67c00, rc 0) 00000100:00100000:3.0:1787764791.389851:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+15:5806:x1874607176967808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764791.389858:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787764791.389882:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa912c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176967808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787764791.389894:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff9dfce1d34400/0xdf82b4f42fb37c03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37c0a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764791.389904:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff9dfce1d34400/0xdf82b4f42fb37c03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf82b4f42fb37c0a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764791.389947:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa912c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176967936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787764791.389969:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764791.389992:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfced8eb540 going to sleep for 11 seconds 00000100:00100000:0.0:1787764791.390010:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176967936 00000100:00100000:0.0:1787764791.390015:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176967936 00000100:00100000:0.0:1787764791.390046:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787764791.390053:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+15:5806:x1874607176967936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787764791.390299:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+15:5806:x1874607176967936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 246us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764791.390307:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787764791.390323:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa912c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176967936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787764791.390364:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa912c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176968064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787764791.390389:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764791.390409:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfced8eb540 going to sleep for 11 seconds 00000100:00100000:3.0:1787764791.390431:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176968064 00000100:00100000:3.0:1787764791.390436:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176968064 00000100:00100000:3.0:1787764791.390458:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787764791.390463:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc3628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+15:5806:x1874607176968064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787764791.390567:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc3628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+15:5806:x1874607176968064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764791.390575:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787764791.390587:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa912c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176968064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787764791.390850:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa912c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8433:1874607176968192:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787764791.390888:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764791.390908:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfced8eb180 going to sleep for 11 seconds 00000100:00100000:0.0:1787764791.390949:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176968192 00000100:00100000:0.0:1787764791.390953:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176968192 00000100:00100000:0.0:1787764791.390980:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787764791.390987:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc3628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+15:8433:x1874607176968192:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787764791.391230:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc3628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+15:8433:x1874607176968192:12345-0@lo:502:llog_process_th.0 Request processed in 243us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764791.391237:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787764791.391255:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa912c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8433:1874607176968192:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787764791.391293:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa912c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8433:1874607176968320:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787764791.391323:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764791.391368:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfced8eb180 going to sleep for 11 seconds 00000100:00100000:3.0:1787764791.391379:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176968320 00000100:00100000:3.0:1787764791.391384:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176968320 00000100:00100000:3.0:1787764791.391410:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787764791.391417:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+15:8433:x1874607176968320:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787764791.391549:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+15:8433:x1874607176968320:12345-0@lo:502:llog_process_th.0 Request processed in 132us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764791.391557:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787764791.391589:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa912c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8433:1874607176968320:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787764791.391609:0:8433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787764791.391687:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787764791.391702:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787764791.391709:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfce1d34400/0xdf82b4f42fb37c03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37c0a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764791.391721:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff9dfce1d34400/0xdf82b4f42fb37c03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37c0a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787764791.391728:0:5806:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787764791.391730:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1787764791.391732:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787764791.391749:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3200/0xdf82b4f42fb37c11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764791.391759:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3200/0xdf82b4f42fb37c11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764791.391767:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3200/0xdf82b4f42fb37c11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764791.391780:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176968448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787764791.391820:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764791.391834:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc7e9ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1787764791.391859:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176968448 00000100:00100000:0.0:1787764791.391864:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176968448 00000100:00100000:0.0:1787764791.391889:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787764791.391896:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+15:5806:x1874607176968448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787764791.391904:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787764791.391914:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dfcc0031400/0xdf82b4f42fb37c18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb37c11 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764791.391944:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfcc0031400/0xdf82b4f42fb37c18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb37c11 expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764791.391952:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dfcc0031400/0xdf82b4f42fb37c18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37c11 expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764791.391958:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcc0031400, rc 0) 00000100:00100000:0.0:1787764791.391983:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+16:5806:x1874607176968448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764791.391987:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787764791.392014:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176968448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787764791.392027:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3200/0xdf82b4f42fb37c11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37c18 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764791.392036:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3200/0xdf82b4f42fb37c11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf82b4f42fb37c18 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764791.392074:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176968576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787764791.392132:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764791.392183:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc7e9ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1787764791.392223:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176968576 00000100:00100000:0.0:1787764791.392228:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176968576 00000100:00100000:0.0:1787764791.392254:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787764791.392261:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+16:5806:x1874607176968576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787764791.392439:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+16:5806:x1874607176968576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 178us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764791.392446:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787764791.392462:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176968576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787764791.392483:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176968704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787764791.392506:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764791.392524:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc7e9ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1787764791.392987:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176968704 00000100:00100000:0.0:1787764791.392993:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176968704 00000100:00100000:0.0:1787764791.393020:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787764791.393027:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+16:5806:x1874607176968704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787764791.393183:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+16:5806:x1874607176968704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764791.393190:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787764791.393200:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176968704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787764791.393466:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8434:1874607176968832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787764791.393499:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764791.393524:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc7e9a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787764791.393551:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176968832 00000100:00100000:0.0:1787764791.393557:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176968832 00000100:00100000:0.0:1787764791.393596:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787764791.393603:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+16:8434:x1874607176968832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787764791.393722:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+16:8434:x1874607176968832:12345-0@lo:502:llog_process_th.0 Request processed in 120us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764791.393728:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787764791.393780:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8434:1874607176968832:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787764791.393800:0:8434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787764791.393808:0:8434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787764791.393810:0:8434:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787764791.393814:0:8434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787764791.393832:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8434:1874607176968960:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787764791.394071:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764791.394120:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176968960 00000100:00100000:0.0:1787764791.394125:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176968960 00000100:00100000:2.0:1787764791.394144:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc7e9a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787764791.394159:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787764791.394167:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc3629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+16:8434:x1874607176968960:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787764791.394356:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc3629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+16:8434:x1874607176968960:12345-0@lo:502:llog_process_th.0 Request processed in 189us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764791.394364:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787764791.394404:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8434:1874607176968960:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787764791.394421:0:8434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787764791.394425:0:8434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787764791.394427:0:8434:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787764791.394430:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1787764791.394494:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1787764791.394524:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787764791.394533:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3200/0xdf82b4f42fb37c11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37c18 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764791.394543:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b3200/0xdf82b4f42fb37c11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37c18 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787764791.394552:0:5806:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787764791.394554:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dfce623b000 from 39 10000000:01000000:3.0:1787764791.394557:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787764791.394577:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcdab66a00/0xdf82b4f42fb37c1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764791.394585:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff9dfcdab66a00/0xdf82b4f42fb37c1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764791.394593:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff9dfcdab66a00/0xdf82b4f42fb37c1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764791.394612:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176969088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787764791.394639:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764791.394661:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcd8a47000 going to sleep for 11 seconds 00000100:00100000:0.0:1787764791.394689:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176969088 00000100:00100000:0.0:1787764791.394695:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176969088 00000100:00100000:0.0:1787764791.394723:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787764791.394731:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc3629c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+16:5806:x1874607176969088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787764791.394739:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787764791.394749:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dfcc0031200/0xdf82b4f42fb37c26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb37c1f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764791.394768:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfcc0031200/0xdf82b4f42fb37c26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb37c1f expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764791.394778:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dfcc0031200/0xdf82b4f42fb37c26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37c1f expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764791.394786:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcc0031200, rc 0) 00000100:00100000:0.0:1787764791.394820:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc3629c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+17:5806:x1874607176969088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764791.394834:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787764791.394843:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176969088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787764791.394856:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff9dfcdab66a00/0xdf82b4f42fb37c1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37c26 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764791.394865:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff9dfcdab66a00/0xdf82b4f42fb37c1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf82b4f42fb37c26 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764791.394905:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176969216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787764791.394929:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764791.394946:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcd8a47000 going to sleep for 11 seconds 00000100:00100000:0.0:1787764791.394969:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176969216 00000100:00100000:0.0:1787764791.394974:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176969216 00000100:00100000:0.0:1787764791.394998:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787764791.395005:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+17:5806:x1874607176969216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787764791.395227:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+17:5806:x1874607176969216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 222us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764791.395235:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787764791.395252:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176969216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787764791.395281:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176969344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787764791.395332:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764791.395372:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcd8a47000 going to sleep for 11 seconds 00000100:00100000:0.0:1787764791.395395:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176969344 00000100:00100000:0.0:1787764791.395400:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176969344 00000100:00100000:0.0:1787764791.395420:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787764791.395425:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+17:5806:x1874607176969344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787764791.395524:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+17:5806:x1874607176969344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764791.395531:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176969344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787764791.395532:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787764791.395756:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcffb5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8435:1874607176969472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787764791.395790:0:8435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764791.395808:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcd84aa780 going to sleep for 11 seconds 00000100:00100000:3.0:1787764791.395816:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176969472 00000100:00100000:3.0:1787764791.395822:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176969472 00000100:00100000:3.0:1787764791.395851:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787764791.395860:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+17:8435:x1874607176969472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787764791.396005:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+17:8435:x1874607176969472:12345-0@lo:502:llog_process_th.0 Request processed in 148us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764791.396022:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787764791.396036:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcffb5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8435:1874607176969472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787764791.396077:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcffb5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8435:1874607176969600:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787764791.396139:0:8435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764791.396166:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176969600 00000100:00100000:0.0:1787764791.396169:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcd84aa780 going to sleep for 11 seconds 00000100:00100000:3.0:1787764791.396171:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176969600 00000100:00100000:3.0:1787764791.396197:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787764791.396203:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+17:8435:x1874607176969600:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787764791.396328:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+17:8435:x1874607176969600:12345-0@lo:502:llog_process_th.0 Request processed in 124us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764791.396348:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787764791.396430:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcffb5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8435:1874607176969600:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787764791.396450:0:8435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787764791.396502:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787764791.396522:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787764791.396529:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcdab66a00/0xdf82b4f42fb37c1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37c26 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764791.396538:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff9dfcdab66a00/0xdf82b4f42fb37c1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37c26 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787764791.396547:0:5806:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787764791.396549:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1787764791.396551:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787764791.396568:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcdab66000/0xdf82b4f42fb37c2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764791.396576:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff9dfcdab66000/0xdf82b4f42fb37c2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764791.396583:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff9dfcdab66000/0xdf82b4f42fb37c2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764791.396596:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176969728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787764791.396629:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764791.396647:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcffb43780 going to sleep for 11 seconds 00000100:00100000:0.0:1787764791.396650:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176969728 00000100:00100000:0.0:1787764791.396654:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176969728 00000100:00100000:0.0:1787764791.396675:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787764791.396679:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+17:5806:x1874607176969728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787764791.396685:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787764791.396692:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dfcc0030a00/0xdf82b4f42fb37c34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb37c2d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764791.396704:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfcc0030a00/0xdf82b4f42fb37c34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb37c2d expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764791.396710:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dfcc0030a00/0xdf82b4f42fb37c34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37c2d expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764791.396715:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcc0030a00, rc 0) 00000100:00100000:0.0:1787764791.396740:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:5806:x1874607176969728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 60us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764791.396744:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787764791.396768:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176969728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787764791.396777:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff9dfcdab66000/0xdf82b4f42fb37c2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37c34 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764791.396782:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff9dfcdab66000/0xdf82b4f42fb37c2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf82b4f42fb37c34 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764791.396809:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176969856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787764791.396825:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764791.396837:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcffb43780 going to sleep for 11 seconds 00000100:00100000:0.0:1787764791.396847:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176969856 00000100:00100000:0.0:1787764791.396852:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176969856 00000100:00100000:0.0:1787764791.396877:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787764791.396884:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:5806:x1874607176969856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787764791.397041:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:5806:x1874607176969856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 156us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764791.397049:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176969856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787764791.397050:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787764791.397077:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176969984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787764791.397136:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764791.397152:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcffb43780 going to sleep for 11 seconds 00000100:00100000:0.0:1787764791.397158:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176969984 00000100:00100000:0.0:1787764791.397163:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176969984 00000100:00100000:0.0:1787764791.397190:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787764791.397198:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:5806:x1874607176969984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787764791.397307:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:5806:x1874607176969984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764791.397311:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176969984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787764791.397317:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787764791.397498:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcffb5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8436:1874607176970112:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787764791.397530:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764791.397548:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcd8fc4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787764791.397555:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176970112 00000100:00100000:3.0:1787764791.397559:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176970112 00000100:00100000:3.0:1787764791.397578:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787764791.397582:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:8436:x1874607176970112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787764791.397679:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:8436:x1874607176970112:12345-0@lo:502:llog_process_th.0 Request processed in 96us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764791.397685:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787764791.397695:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcffb5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8436:1874607176970112:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787764791.397719:0:8436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787764791.397726:0:8436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787764791.397728:0:8436:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787764791.397733:0:8436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787764791.397751:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcffb5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8436:1874607176970240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787764791.397782:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764791.397800:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcd8fc4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787764791.397807:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176970240 00000100:00100000:3.0:1787764791.397817:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176970240 00000100:00100000:3.0:1787764791.397842:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787764791.397849:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:8436:x1874607176970240:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787764791.397966:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:8436:x1874607176970240:12345-0@lo:502:llog_process_th.0 Request processed in 117us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764791.397972:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787764791.397976:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcffb5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8436:1874607176970240:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787764791.397994:0:8436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787764791.397997:0:8436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787764791.397999:0:8436:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787764791.398002:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1787764791.398033:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1787764791.398048:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787764791.398054:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcdab66000/0xdf82b4f42fb37c2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37c34 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764791.398060:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff9dfcdab66000/0xdf82b4f42fb37c2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37c34 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787764791.398066:0:5806:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787764791.398068:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9dfcc4e21a48 from 1 10000000:01000000:3.0:1787764791.398069:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787764791.398102:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67a00/0xdf82b4f42fb37c3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764791.398108:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67a00/0xdf82b4f42fb37c3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764791.398113:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67a00/0xdf82b4f42fb37c3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764791.398123:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176970368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787764791.398140:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764791.398155:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcffb43a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787764791.398162:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176970368 00000100:00100000:0.0:1787764791.398168:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176970368 00000100:00100000:0.0:1787764791.398197:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787764791.398204:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:5806:x1874607176970368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787764791.398211:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787764791.398220:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dfcc0031e00/0xdf82b4f42fb37c42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb37c3b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764791.398242:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfcc0031e00/0xdf82b4f42fb37c42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb37c3b expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764791.398251:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dfcc0031e00/0xdf82b4f42fb37c42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37c3b expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764791.398258:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcc0031e00, rc 0) 00000100:00100000:0.0:1787764791.398288:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:5806:x1874607176970368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764791.398296:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787764791.398312:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176970368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787764791.398325:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67a00/0xdf82b4f42fb37c3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37c42 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764791.398332:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67a00/0xdf82b4f42fb37c3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf82b4f42fb37c42 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764791.398378:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176970496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787764791.398402:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764791.398418:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcffb43a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787764791.398425:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176970496 00000100:00100000:0.0:1787764791.398430:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176970496 00000100:00100000:0.0:1787764791.398456:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787764791.398462:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:5806:x1874607176970496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787764791.398582:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:5806:x1874607176970496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (180us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787764791.398588:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787764791.398606:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176970496:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1787764791.398626:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787764791.398631:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67a00/0xdf82b4f42fb37c3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37c42 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764791.398638:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67a00/0xdf82b4f42fb37c3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37c42 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764791.767370:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787764792.520022:0:8473:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff10748720 20000000:00000080:1.0:1787764792.520037:0:8473:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dfbc2712c00 uarg=0000000000000000 20000000:01000000:1.0:1787764792.520067:0:8473:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787764792.520072:0:8473:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787764792.520076:0:8473:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787764792.520889:0:8474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1787764792.521024:0:8473:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1787764792.523372:0:8473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1787764792.523418:0:8473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1787764792.523472:0:8473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1787764792.523487:0:8473:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787764792.523505:0:8473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dfcc92b2e00/0xdf82b4f42fb37c49 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764792.523522:0:8473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dfcc92b3000/0xdf82b4f42fb37a12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37a0b expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764792.523530:0:8473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dfcc92b2200/0xdf82b4f42fb37a89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37a82 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764792.523538:0:8473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dfce1d34800/0xdf82b4f42fb37aeb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37ae4 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764792.523548:0:8473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dfcdab67800/0xdf82b4f42fb37b38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725ad5 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764792.523556:0:8473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dfcc92b2e00/0xdf82b4f42fb37c49 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764792.523591:0:8473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dfcdab67800/0xdf82b4f42fb37b38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725ad5 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764792.523605:0:8473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dfcdab67800/0xdf82b4f42fb37b38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725ad5 expref: 9 pid: 5803 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764792.523620:0:8473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8473:1874607176970624:192.168.202.53@tcp:104: 00010000:00010000:2.0:1787764792.525809:0:8473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dfce1d34800/0xdf82b4f42fb37aeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf82b4f42fb37ae4 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764792.525825:0:8473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dfce1d34800/0xdf82b4f42fb37aeb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf82b4f42fb37ae4 expref: 18 pid: 5804 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764792.525848:0:8473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8473:1874607176970752:0@lo:104: 00000100:00100000:2.0:1787764792.525898:0:8473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787764792.525937:0:8473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dfcc92b2200/0xdf82b4f42fb37a89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf82b4f42fb37a82 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764792.525947:0:8473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dfcc92b2200/0xdf82b4f42fb37a89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf82b4f42fb37a82 expref: 18 pid: 5803 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764792.525956:0:8473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668f0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8473:1874607176970880:0@lo:104: 00000100:00100000:2.0:1787764792.525976:0:8473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764792.526057:0:7602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176970752 00000100:00100000:0.0:1787764792.526064:0:7602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176970752 00000100:00100000:3.0:1787764792.526219:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176970880 00000100:00100000:3.0:1787764792.526225:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176970880 00000100:00100000:0.0:1787764792.526307:0:7602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787764792.526323:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787764792.526334:0:7602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc668fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+4:8473:x1874607176970880:12345-0@lo:104: 00000100:00100000:3.0:1787764792.526345:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc668e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+4:8473:x1874607176970752:12345-0@lo:104: 00010000:00010000:0.0:1787764792.526349:0:7602:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff9dfce1d34c00/0xdf82b4f42fb37a82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37a89 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764792.526355:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2600/0xdf82b4f42fb37ae4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37aeb expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764792.528137:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00010000:00010000:2.0:1787764792.528302:0:8473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dfcc92b3000/0xdf82b4f42fb37a12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf82b4f42fb37a0b expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764792.528311:0:7602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1787764792.528316:0:8473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dfcc92b3000/0xdf82b4f42fb37a12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf82b4f42fb37a0b expref: 18 pid: 5804 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764792.528340:0:8473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668c3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8473:1874607176971008:0@lo:104: 00000100:00100000:2.0:1787764792.528371:0:8473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764792.528381:0:8473:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc5d78780 going to sleep for 11 seconds 00000100:00100000:0.0:1787764792.528388:0:7602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc668fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+4:8473:x1874607176970880:12345-0@lo:104: Request processed in 2006us (2344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764792.528402:0:8473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8473:1874607176970624:192.168.202.53@tcp:104: 00000100:00100000:2.0:1787764792.528411:0:8473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668f0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8473:1874607176970880:0@lo:104: 00000100:00100000:0.0:1787764792.528497:0:7602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787764792.528526:0:7602:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787764792.528536:0:7602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176971008 00000100:00100000:0.0:1787764792.528540:0:7602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176971008 00000100:00100000:0.0:1787764792.528560:0:7602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787764792.528567:0:7602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfbc30ea050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+4:8473:x1874607176971008:12345-0@lo:104: 00010000:00010000:0.0:1787764792.528575:0:7602:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff9dfce1d34600/0xdf82b4f42fb37a0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37a12 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764792.528623:0:7602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787764792.528629:0:7602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfbc30ea050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+4:8473:x1874607176971008:12345-0@lo:104: Request processed in 62us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764792.528634:0:7602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1787764792.528650:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787764792.528655:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff9dfce1d34c00/0xdf82b4f42fb37a82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37a89 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764792.528663:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfce1d34c00 already unused, calling callback (ffffffffc1cc6c20) 10000000:00010000:0.0:1787764792.528667:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff9dfce1d34c00/0xdf82b4f42fb37a82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf82b4f42fb37a89 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764792.528674:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff9dfce1d34c00/0xdf82b4f42fb37a82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf82b4f42fb37a89 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787764792.528682:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff9dfce1d34c00/0xdf82b4f42fb37a82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf82b4f42fb37a89 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787764792.528687:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787764792.528713:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff9dfce1d34c00/0xdf82b4f42fb37a82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37a89 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764792.528786:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787764792.528807:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff9dfce1d34c00/0xdf82b4f42fb37a82 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37a89 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764792.528815:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff9dfce1d34c00/0xdf82b4f42fb37a82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37a89 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764792.528829:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787764792.528832:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff9dfce1d34600/0xdf82b4f42fb37a0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37a12 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764792.528837:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfce1d34600 already unused, calling callback (ffffffffc1cc6c20) 10000000:00010000:0.0:1787764792.528840:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff9dfce1d34600/0xdf82b4f42fb37a0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf82b4f42fb37a12 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764792.528847:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff9dfce1d34600/0xdf82b4f42fb37a0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf82b4f42fb37a12 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787764792.528853:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff9dfce1d34600/0xdf82b4f42fb37a0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf82b4f42fb37a12 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787764792.528858:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787764792.528871:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff9dfce1d34600/0xdf82b4f42fb37a0b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37a12 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764792.528876:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787764792.528882:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff9dfce1d34600/0xdf82b4f42fb37a0b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37a12 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764792.528887:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff9dfce1d34600/0xdf82b4f42fb37a0b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37a12 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764792.528900:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764792.528902:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764792.528903:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764792.528915:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcffb5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3288:1874607176971136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787764792.528940:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764792.528960:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787764792.528965:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcffb59e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3288:1874607176971264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787764792.528982:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764792.529007:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164363904 00000100:00100000:0.0:1787764792.529010:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164363904 00010000:00010000:0.0:1787764792.529028:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dfcdab67800/0xdf82b4f42fb37b38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725ad5 expref: 10 pid: 5803 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764792.529045:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176971136 00000100:00100000:0.0:1787764792.529047:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176971136 00010000:00010000:0.0:1787764792.529056:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dfcc92b2200/0xdf82b4f42fb37a89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37a82 expref: 19 pid: 5803 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764792.529070:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176971264 00000100:00100000:0.0:1787764792.529072:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176971264 00010000:00010000:0.0:1787764792.529095:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dfcc92b3000/0xdf82b4f42fb37a12 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37a0b expref: 20 pid: 5804 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764792.529392:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 20 00000100:00100000:0.0:1787764792.529445:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaa912c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2346:x1874607164363904:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787764792.529455:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787764792.529461:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dfcdab67800/0xdf82b4f42fb37b38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725ad5 expref: 10 pid: 5803 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764792.529479:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dfcdab67800/0xdf82b4f42fb37b38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725ad5 expref: 10 pid: 5803 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764792.529492:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dfcdab67800/0xdf82b4f42fb37b38 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725ad5 expref: 10 pid: 5803 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764792.529503:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787764792.529538:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaa912c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e307722-e9dd-4631-8a6a-b36b6b831f0c+9:2346:x1874607164363904:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 139us (1406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764792.529544:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 20 00000100:00100000:0.0:1787764792.529557:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787764792.529563:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffb592c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+20:3288:x1874607176971136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787764792.529570:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787764792.529575:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dfcc92b2200/0xdf82b4f42fb37a89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37a82 expref: 20 pid: 5803 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764792.529582:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dfcc92b2200/0xdf82b4f42fb37a89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf82b4f42fb37a82 expref: 20 pid: 5803 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764792.529591:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dfcc92b2200/0xdf82b4f42fb37a89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf82b4f42fb37a82 expref: 20 pid: 5803 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764792.529599:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787764792.529624:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffb592c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3288:x1874607176971136:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764792.529630:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787764792.529640:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787764792.529646:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffb59a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:3288:x1874607176971264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787764792.529659:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787764792.529663:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dfcc92b3000/0xdf82b4f42fb37a12 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37a0b expref: 18 pid: 5804 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764792.529671:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dfcc92b3000/0xdf82b4f42fb37a12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf82b4f42fb37a0b expref: 18 pid: 5804 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764792.529682:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787764792.529706:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764792.529707:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffb59a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:3288:x1874607176971264:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764792.529715:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787764792.529807:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcffb59e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3288:1874607176971264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787764792.529821:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcffb5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3288:1874607176971136:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787764792.529896:0:8473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dfcc92b3000/0xdf82b4f42fb37a12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf82b4f42fb37a0b expref: 17 pid: 5804 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764792.529909:0:8473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668c3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8473:1874607176971008:0@lo:104: 00010000:00010000:3.0:1787764792.530108:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787764792.530116:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc668e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+3:8473:x1874607176970752:12345-0@lo:104: Request processed in 3774us (4217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764792.530131:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787764792.530535:0:8473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8473:1874607176970752:0@lo:104: 00010000:00010000:2.0:1787764792.530555:0:8473:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dfcc92b2e00/0xdf82b4f42fb37c49 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764792.531957:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787764792.531965:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2600/0xdf82b4f42fb37ae4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37aeb expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764792.531976:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcc92b2600 already unused, calling callback (ffffffffc1cc6c20) 10000000:00010000:0.0:1787764792.531979:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2600/0xdf82b4f42fb37ae4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf82b4f42fb37aeb expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764792.531988:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2600/0xdf82b4f42fb37ae4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf82b4f42fb37aeb expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787764792.531995:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2600/0xdf82b4f42fb37ae4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf82b4f42fb37aeb expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787764792.532000:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787764792.532047:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2600/0xdf82b4f42fb37ae4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37aeb expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764792.532053:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787764792.532100:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2600/0xdf82b4f42fb37ae4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37aeb expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764792.532109:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff9dfcc92b2600/0xdf82b4f42fb37ae4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37aeb expref: -99 pid: 7596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764792.532128:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764792.532130:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764792.532132:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764792.532172:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcffb5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3286:1874607176971392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787764792.532207:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764792.532314:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176971392 00000100:00100000:0.0:1787764792.532321:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176971392 00010000:00010000:0.0:1787764792.532358:0:6286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dfce1d34800/0xdf82b4f42fb37aeb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37ae4 expref: 17 pid: 5804 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764792.532389:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787764792.532398:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc668f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+17:3286:x1874607176971392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787764792.532408:0:6286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787764792.532413:0:6286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dfce1d34800/0xdf82b4f42fb37aeb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37ae4 expref: 17 pid: 5804 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764792.532423:0:6286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dfce1d34800/0xdf82b4f42fb37aeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf82b4f42fb37ae4 expref: 17 pid: 5804 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764792.532435:0:6286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dfce1d34800/0xdf82b4f42fb37aeb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf82b4f42fb37ae4 expref: 17 pid: 5804 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764792.532448:0:6286:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dfcc92b2e00/0xdf82b4f42fb37c49 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764792.532461:0:6286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfcc92b2e00/0xdf82b4f42fb37c49 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764792.532476:0:6286:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dfcc92b2e00/0xdf82b4f42fb37c49 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764792.532483:0:6286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dfcc92b2e00/0xdf82b4f42fb37c49 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764792.532491:0:6286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dfcc92b2e00/0xdf82b4f42fb37c49 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764792.532497:0:6286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dfcc92b2e00/0xdf82b4f42fb37c49 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764792.532503:0:6286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcc92b2e00 already unused, calling callback (ffffffffc16cb530) 00010000:00010000:0.0:1787764792.532507:0:6286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dfcc92b2e00/0xdf82b4f42fb37c49 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764792.532514:0:6286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dfcc92b2e00/0xdf82b4f42fb37c49 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764792.532537:0:6286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dfcc92b2e00/0xdf82b4f42fb37c49 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764792.532547:0:6286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787764792.532554:0:8473:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dfcc92b2e00/0xdf82b4f42fb37c49 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764792.532565:0:8473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dfcc92b2e00/0xdf82b4f42fb37c49 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764792.532573:0:8473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dfcc92b2e00/0xdf82b4f42fb37c49 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764792.532602:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc668f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+16:3286:x1874607176971392:12345-0@lo:103:ldlm_bl.0 Request processed in 202us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764792.532610:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787764792.533135:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcffb5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3286:1874607176971392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787764792.535374:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787764792.535389:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176971520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787764792.535435:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764792.535502:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176971520 00000100:00100000:3.0:1787764792.535509:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176971520 00000100:00100000:3.0:1787764792.535570:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787764792.535581:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc668c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607176971520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787764792.535614:0:6656:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787764792.535655:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc668c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607176971520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764792.535662:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1787764792.535713:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787764792.535736:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcc32ffc00 x1874607176971520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764792.535753:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176971520:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787764792.791628:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787764793.348999:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1787764793.349043:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764793.349044:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164364160 00000100:00100000:3.0:1787764793.349053:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164364160 00000100:00100000:2.0:1787764793.349107:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164364416 00000100:00100000:1.0:1787764793.349112:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1787764793.349115:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164364416 00000100:00100000:0.0:1787764793.349140:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164364032 00000100:00100000:0.0:1787764793.349147:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164364032 00000100:00100000:3.0:1787764793.349147:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00100000:1.0:1787764793.349154:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764793.349163:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaa93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2347:x1874607164364160:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1787764793.349188:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164364288 00000100:00100000:1.0:1787764793.349193:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164364288 00000100:00100000:0.0:1787764793.349196:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 164 00000100:00100000:0.0:1787764793.349209:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e307722-e9dd-4631-8a6a-b36b6b831f0c+9:2347:x1874607164364032:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1787764793.349231:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaa93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2347:x1874607164364160:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 71us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764793.349238:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00080000:2.0:1787764793.349241:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787764793.349245:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:0.0:1787764793.349248:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e307722-e9dd-4631-8a6a-b36b6b831f0c+9:2347:x1874607164364032:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 41us (136us total) trans 0 rc 0/0 00000100:00080000:2.0:1787764793.349248:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787764793.349252:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787764793.349258:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaa90b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c035addb-e6b1-4a9c-9554-21f3e0d84883+5:2347:x1874607164364416:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1787764793.349263:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 164 00000100:00100000:2.0:1787764793.349270:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 8 00000100:00100000:2.0:1787764793.349279:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaa91680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+5:2347:x1874607164364288:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1787764793.349298:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaa90b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c035addb-e6b1-4a9c-9554-21f3e0d84883+5:2347:x1874607164364416:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 43us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764793.349312:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaa91680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+5:2347:x1874607164364288:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 34us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764793.349316:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:2.0:1787764793.349343:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 8 10000000:01000000:3.0:1787764793.367140:0:5806:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787764793.367147:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dfcffb13800 from 4 10000000:01000000:3.0:1787764793.367151:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787764793.367199:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67200/0xdf82b4f42fb37c50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764793.367212:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67200/0xdf82b4f42fb37c50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764793.367224:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67200/0xdf82b4f42fb37c50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764793.367260:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fe580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176971648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787764793.367335:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764793.367387:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176971648 00000100:00100000:3.0:1787764793.367387:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcffb436c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787764793.367396:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176971648 00000100:00100000:1.0:1787764793.367446:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787764793.367456:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+16:5806:x1874607176971648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787764793.367467:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787764793.367478:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dfce1d35a00/0xdf82b4f42fb37c57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb37c50 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764793.367499:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfce1d35a00/0xdf82b4f42fb37c57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb37c50 expref: 17 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764793.367510:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dfce1d35a00/0xdf82b4f42fb37c57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37c50 expref: 17 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764793.367519:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfce1d35a00, rc 0) 00000100:00100000:1.0:1787764793.367573:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+17:5806:x1874607176971648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764793.367582:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787764793.367600:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fe580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176971648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787764793.367623:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67200/0xdf82b4f42fb37c50 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37c57 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764793.367633:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67200/0xdf82b4f42fb37c50 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf82b4f42fb37c57 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764793.367690:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fe580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176971776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787764793.367722:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764793.367748:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcffb436c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787764793.367777:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176971776 00000100:00100000:1.0:1787764793.367783:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176971776 00000100:00100000:1.0:1787764793.367815:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787764793.367823:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+17:5806:x1874607176971776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787764793.368071:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+17:5806:x1874607176971776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764793.368102:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787764793.368121:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fe580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176971776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787764793.368155:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fe580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176971904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787764793.368195:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764793.368227:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcffb436c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787764793.368440:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176971904 00000100:00100000:1.0:1787764793.368450:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176971904 00000100:00100000:1.0:1787764793.368477:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787764793.368482:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+17:5806:x1874607176971904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787764793.371132:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+17:5806:x1874607176971904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2642us (2929us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764793.371145:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787764793.371154:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fe580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176971904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787764793.371462:0:8578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa921c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8578:1874607176972032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787764793.371501:0:8578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764793.371543:0:8578:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfced8ebc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787764793.371592:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176972032 00000100:00100000:0.0:1787764793.371597:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176972032 00000100:00100000:0.0:1787764793.371653:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787764793.371664:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+17:8578:x1874607176972032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787764793.371882:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+17:8578:x1874607176972032:12345-0@lo:502:llog_process_th.0 Request processed in 220us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764793.371890:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787764793.372108:0:8578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa921c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8578:1874607176972032:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787764793.372127:0:8578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787764793.372137:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787764793.372140:0:8578:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787764793.372147:0:8578:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dfcffb13800 00000020:00000080:1.0:1787764793.372149:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787764793.372222:0:8578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa921c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8578:1874607176972160:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787764793.372259:0:8578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764793.372286:0:8578:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfced8ebc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787764793.372303:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176972160 00000100:00100000:3.0:1787764793.372309:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176972160 00000100:00100000:3.0:1787764793.372371:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787764793.372380:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+17:8578:x1874607176972160:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787764793.372507:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+17:8578:x1874607176972160:12345-0@lo:502:llog_process_th.0 Request processed in 129us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764793.372519:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787764793.372632:0:8578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa921c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8578:1874607176972160:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787764793.372647:0:8578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787764793.372650:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787764793.372652:0:8578:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787764793.372655:0:8578:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787764793.372798:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787764793.372829:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787764793.372839:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67200/0xdf82b4f42fb37c50 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37c57 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764793.372850:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67200/0xdf82b4f42fb37c50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37c57 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787764793.372862:0:5806:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787764793.372865:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dfcf55aa800 from 4 10000000:01000000:3.0:1787764793.372868:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787764793.372893:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67600/0xdf82b4f42fb37c5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764793.372902:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67600/0xdf82b4f42fb37c5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764793.372912:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67600/0xdf82b4f42fb37c5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764793.372926:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fe580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176972288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787764793.372960:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764793.376539:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176972288 00000100:00100000:2.0:1787764793.376551:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176972288 00000100:00100000:3.0:1787764793.376576:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcffb430c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787764793.376628:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787764793.376639:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+17:5806:x1874607176972288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787764793.376656:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764793.376674:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dfcc92b3800/0xdf82b4f42fb37c65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb37c5e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764793.376702:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfcc92b3800/0xdf82b4f42fb37c65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb37c5e expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764793.376714:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dfcc92b3800/0xdf82b4f42fb37c65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37c5e expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764793.376723:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcc92b3800, rc 0) 00000100:00100000:2.0:1787764793.376822:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:5806:x1874607176972288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (3860us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764793.376829:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787764793.376982:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fe580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176972288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787764793.376995:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67600/0xdf82b4f42fb37c5e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37c65 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764793.377002:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67600/0xdf82b4f42fb37c5e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf82b4f42fb37c65 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764793.377077:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fe580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176972416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787764793.377136:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764793.377163:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcffb430c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787764793.377170:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176972416 00000100:00100000:2.0:1787764793.377176:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176972416 00000100:00100000:2.0:1787764793.377208:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787764793.377217:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:5806:x1874607176972416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787764793.377654:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:5806:x1874607176972416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 438us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764793.377664:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787764793.377684:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fe580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176972416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787764793.377723:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcffb5bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176972544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787764793.377787:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764793.377809:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcf55b40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787764793.377820:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176972544 00000100:00100000:2.0:1787764793.377833:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176972544 00000100:00100000:2.0:1787764793.377869:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787764793.377877:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:5806:x1874607176972544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787764793.378050:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:5806:x1874607176972544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764793.378060:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcffb5bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176972544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787764793.378060:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787764793.378388:0:8582:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa921c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8582:1874607176972672:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787764793.378431:0:8582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764793.378467:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176972672 00000100:00100000:1.0:1787764793.378471:0:8582:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfced8ebf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787764793.378472:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176972672 00000100:00100000:0.0:1787764793.378497:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787764793.378502:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:8582:x1874607176972672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787764793.378683:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:8582:x1874607176972672:12345-0@lo:502:llog_process_th.0 Request processed in 179us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764793.378701:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787764793.378710:0:8582:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa921c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8582:1874607176972672:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787764793.378740:0:8582:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787764793.378751:0:8582:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787764793.378754:0:8582:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787764793.378761:0:8582:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dfcf55aa800 00000020:00000080:1.0:1787764793.378763:0:8582:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787764793.378842:0:8582:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaa921c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8582:1874607176972800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787764793.378887:0:8582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764793.378912:0:8582:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfced8ebf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787764793.378913:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176972800 00000100:00100000:2.0:1787764793.378919:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176972800 00000100:00100000:2.0:1787764793.378953:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787764793.378963:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:8582:x1874607176972800:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787764793.379289:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:8582:x1874607176972800:12345-0@lo:502:llog_process_th.0 Request processed in 327us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764793.379297:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787764793.379308:0:8582:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaa921c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8582:1874607176972800:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787764793.379362:0:8582:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787764793.379368:0:8582:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787764793.379369:0:8582:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787764793.379374:0:8582:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787764793.379476:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787764793.379492:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787764793.379499:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67600/0xdf82b4f42fb37c5e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37c65 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764793.379507:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67600/0xdf82b4f42fb37c5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37c65 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787764793.379516:0:5806:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787764793.379519:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dfce623b000 from 4 10000000:01000000:0.0:1787764793.379522:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787764793.379544:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcc0031600/0xdf82b4f42fb37c6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764793.379552:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff9dfcc0031600/0xdf82b4f42fb37c6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764793.379560:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff9dfcc0031600/0xdf82b4f42fb37c6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764793.379574:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcffb5bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176972928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787764793.379609:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764793.379634:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176972928 00000100:00100000:1.0:1787764793.379639:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176972928 00000100:00100000:0.0:1787764793.379641:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc7e9ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1787764793.379672:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787764793.379683:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:5806:x1874607176972928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787764793.379693:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787764793.379706:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dfce1d34e00/0xdf82b4f42fb37c73 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb37c6c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764793.379726:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfce1d34e00/0xdf82b4f42fb37c73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb37c6c expref: 19 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764793.379734:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dfce1d34e00/0xdf82b4f42fb37c73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37c6c expref: 19 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764793.379740:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfce1d34e00, rc 0) 00000100:00100000:1.0:1787764793.379781:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:5806:x1874607176972928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764793.379787:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787764793.379795:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcffb5bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176972928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787764793.379810:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff9dfcc0031600/0xdf82b4f42fb37c6c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37c73 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764793.379819:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff9dfcc0031600/0xdf82b4f42fb37c6c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf82b4f42fb37c73 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764793.379873:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcffb5bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176973056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787764793.379905:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764793.379927:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc7e9ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1787764793.379931:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176973056 00000100:00100000:1.0:1787764793.379936:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176973056 00000100:00100000:1.0:1787764793.379964:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787764793.379974:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:5806:x1874607176973056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787764793.380186:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:5806:x1874607176973056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 214us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764793.380192:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787764793.380204:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcffb5bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176973056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787764793.380232:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcffb5bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176973184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787764793.380274:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764793.380291:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176973184 00000100:00100000:1.0:1787764793.380295:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176973184 00000100:00100000:0.0:1787764793.380304:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc7e9ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1787764793.380333:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787764793.380342:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:5806:x1874607176973184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787764793.380451:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:5806:x1874607176973184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764793.380457:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787764793.380464:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcffb5bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176973184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787764793.380645:0:8584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcffb5bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8584:1874607176973312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787764793.380684:0:8584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764793.380703:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176973312 00000100:00100000:0.0:1787764793.380704:0:8584:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc7e9a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787764793.380707:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176973312 00000100:00100000:1.0:1787764793.380731:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787764793.380737:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:8584:x1874607176973312:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787764793.380876:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:8584:x1874607176973312:12345-0@lo:502:llog_process_th.0 Request processed in 138us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764793.380883:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787764793.380922:0:8584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcffb5bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8584:1874607176973312:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787764793.380942:0:8584:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787764793.380947:0:8584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787764793.380949:0:8584:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787764793.380955:0:8584:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dfce623b000 00000020:00000080:0.0:1787764793.380958:0:8584:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787764793.381020:0:8584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcffb5bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8584:1874607176973440:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787764793.381058:0:8584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764793.381075:0:8584:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc7e9a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787764793.381551:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176973440 00000100:00100000:1.0:1787764793.381556:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176973440 00000100:00100000:1.0:1787764793.381587:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787764793.381603:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:8584:x1874607176973440:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787764793.381750:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:8584:x1874607176973440:12345-0@lo:502:llog_process_th.0 Request processed in 149us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764793.381757:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787764793.381791:0:8584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcffb5bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:8584:1874607176973440:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787764793.381818:0:8584:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787764793.381824:0:8584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787764793.381832:0:8584:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787764793.381837:0:8584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787764793.381892:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787764793.381916:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787764793.381924:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcc0031600/0xdf82b4f42fb37c6c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37c73 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764793.381934:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff9dfcc0031600/0xdf82b4f42fb37c6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37c73 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764793.815232:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787764794.181549:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1787764794.181707:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164364544 00000100:00100000:2.0:1787764794.181717:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164364544 00000100:00100000:2.0:1787764794.181775:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 180 00000100:00100000:2.0:1787764794.181787:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e307722-e9dd-4631-8a6a-b36b6b831f0c+9:5577:x1874607164364544:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787764794.181804:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764794.181835:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dfcc92b3000/0xdf82b4f42fb37c7a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2033f7a1f5725b14 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764794.181864:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfcc92b3000/0xdf82b4f42fb37c7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b14 expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764794.181878:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dfcc92b3000/0xdf82b4f42fb37c7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b14 expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764794.181887:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcc92b3000, rc 0) 00000100:00100000:2.0:1787764794.181952:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:5577:x1874607164364544:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 Request processed in 168us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764794.181957:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 180 00000100:00100000:2.0:1787764794.183590:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764794.183733:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164364672 00000100:00100000:3.0:1787764794.183739:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164364672 00000100:00100000:3.0:1787764794.183778:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 181 00000100:00100000:3.0:1787764794.183786:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:5577:x1874607164364672:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787764794.184056:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:5577:x1874607164364672:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 Request processed in 270us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764794.184065:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 181 00000100:00100000:1.0:1787764794.185121:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1787764794.185156:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164364800 00000100:00100000:2.0:1787764794.185163:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164364800 00000100:00100000:2.0:1787764794.185194:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 182 00000100:00100000:2.0:1787764794.185201:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:5577:x1874607164364800:12345-192.168.202.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787764794.185367:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:5577:x1874607164364800:12345-192.168.202.53@tcp:503:ll_cfg_requeue.0 Request processed in 166us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764794.185376:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 182 00000100:00100000:0.0:1787764794.189750:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764794.189786:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164364928 00000100:00100000:3.0:1787764794.189834:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164364928 00000100:00100000:3.0:1787764794.189886:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 183 00000100:00100000:3.0:1787764794.189898:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:6280:x1874607164364928:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787764794.190125:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:6280:x1874607164364928:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 229us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764794.190132:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 183 00000100:00100000:3.0:1787764794.191258:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1787764794.191942:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164365056 00000100:00100000:2.0:1787764794.191950:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164365056 00000100:00100000:2.0:1787764794.191993:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 184 00000100:00100000:2.0:1787764794.192001:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:6280:x1874607164365056:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787764794.192172:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:6280:x1874607164365056:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 170us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764794.192181:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 184 00000100:00100000:3.0:1787764794.584340:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1874607176973696:0@lo:400:kworker.0 00000100:00100000:3.0:1787764794.584546:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764794.584591:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfbc3077c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176974208:0@lo:400:kworker.0 00000100:00100000:3.0:1787764794.584613:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764794.584641:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787764794.584646:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3289:1874607176973568:0@lo:400:kworker.0 00000100:00100000:3.0:1787764794.584676:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764794.584694:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfbc30743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607176974080:0@lo:400:kworker.0 00000100:00100000:3.0:1787764794.584711:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764794.584731:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176973952:0@lo:400:kworker.0 00000100:00100000:3.0:1787764794.584750:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764794.584766:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787764794.584770:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1874607176973824:0@lo:400:kworker.0 00000100:00100000:3.0:1787764794.584786:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764794.584798:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfbc3075a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176974336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787764794.584813:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764794.584835:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176973696 00000100:00100000:3.0:1787764794.584841:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176973696 00000100:00100000:3.0:1787764794.584873:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176974080 00000100:00100000:3.0:1787764794.584875:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176974080 00000100:00100000:3.0:1787764794.584892:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176973824 00000100:00100000:3.0:1787764794.584894:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176973824 00000100:00100000:3.0:1787764794.584907:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787764794.584914:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfbc3077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1874607176973696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764794.584957:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfbc3077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1874607176973696:12345-0@lo:400:kworker.0 Request processed in 43us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764794.584964:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787764794.584989:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787764794.584995:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfbc3075e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607176974080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764794.585017:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfbc3075e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607176974080:12345-0@lo:400:kworker.0 Request processed in 23us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764794.585022:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787764794.585038:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787764794.585043:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfbc3074780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1874607176973824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764794.585067:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfbc3074780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1874607176973824:12345-0@lo:400:kworker.0 Request processed in 25us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764794.585073:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787764794.585104:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176974208 00000100:00100000:3.0:1787764794.585416:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176974208 00000100:00100000:3.0:1787764794.585445:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176973952 00000100:00100000:3.0:1787764794.585448:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176973952 00000100:00100000:3.0:1787764794.585465:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787764794.585471:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfbc30752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176974208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764794.585499:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfbc30752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176974208:12345-0@lo:400:kworker.0 Request processed in 28us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764794.585504:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787764794.585514:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787764794.585518:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfbc3076940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176973952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764794.585543:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfbc3076940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176973952:12345-0@lo:400:kworker.0 Request processed in 25us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764794.585548:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787764794.585563:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176973568 00000100:00100000:3.0:1787764794.585565:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176973568 00000100:00100000:3.0:1787764794.585585:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787764794.585590:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc5d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3289:x1874607176973568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764794.585613:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc5d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3289:x1874607176973568:12345-0@lo:400:kworker.0 Request processed in 23us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764794.585619:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787764794.585649:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176974336 00000100:00100000:3.0:1787764794.585657:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176974336 00000100:00100000:3.0:1787764794.585676:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787764794.585681:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfbc3076d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176974336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787764794.585706:0:6656:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787764794.585733:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfbc3076d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176974336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764794.585739:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787764794.585780:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1874607176973824:0@lo:400:kworker.0 00010000:00080000:3.0:1787764794.585792:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfbc3075a40 x1874607176974336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764810 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764794.585801:0:3287:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787764794.585818:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfbc3075a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176974336:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787764794.585827:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcc32ffc00 x1874607176973952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764794.585835:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176973952:0@lo:400:kworker.0 00000100:00100000:3.0:1787764794.585857:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3289:1874607176973568:0@lo:400:kworker.0 00000100:00100000:3.0:1787764794.585866:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfbc30743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607176974080:0@lo:400:kworker.0 00000100:00100000:3.0:1787764794.585875:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1874607176973696:0@lo:400:kworker.0 00010000:00080000:3.0:1787764794.585882:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfbc3077c00 x1874607176974208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764794.585890:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfbc3077c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176974208:0@lo:400:kworker.0 00000100:00080000:0.0:1787764794.586606:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787764794.586610:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787764794.586613:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787764794.840898:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787764794.859747:0:8773:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1787764795.864254:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764796.887261:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764797.655638:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176974464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787764797.655702:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764797.655770:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176974464 00000100:00100000:2.0:1787764797.655777:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176974464 00000100:00100000:2.0:1787764797.655824:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787764797.655833:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc668f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176974464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787764797.655867:0:6656:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787764797.655916:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc668f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176974464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764797.655924:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1787764797.655943:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787764797.655980:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcc668de00 x1874607176974464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764797.655997:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176974464:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787764797.912192:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787764797.986509:0:9016:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing yml_node 00000100:00100000:0.0:1787764798.471151:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1787764798.471192:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1787764798.471225:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764798.471239:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164365440 00000100:00100000:3.0:1787764798.471253:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164365440 00000100:00100000:0.0:1787764798.471258:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1787764798.471305:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164365312 00000100:00100000:0.0:1787764798.471310:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164365312 00000100:00100000:3.0:1787764798.471318:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164365568 00000100:00100000:3.0:1787764798.471322:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164365568 00000100:00100000:3.0:1787764798.471348:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 11 00000100:00100000:3.0:1787764798.471358:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffb5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+5:2348:x1874607164365440:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1787764798.471365:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 21 00000100:00100000:0.0:1787764798.471377:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffb5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2348:x1874607164365312:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1787764798.471439:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffb5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2348:x1874607164365312:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 63us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764798.471440:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffb5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+5:2348:x1874607164365440:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 83us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764798.471452:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 11 00000100:00100000:1.0:1787764798.471457:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164365184 00000100:00100000:0.0:1787764798.471462:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 21 00000100:00100000:1.0:1787764798.471463:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164365184 00000100:00100000:3.0:1787764798.471473:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 12 00000100:00100000:3.0:1787764798.471481:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffb5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+5:2348:x1874607164365568:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1787764798.471500:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 186 00000100:00100000:3.0:1787764798.471504:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffb5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+5:2348:x1874607164365568:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 23us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764798.471515:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 12 00000100:00100000:1.0:1787764798.471516:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc5d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2348:x1874607164365184:12345-192.168.202.53@tcp:400:kworker.0 00000100:00080000:3.0:1787764798.471537:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787764798.471542:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787764798.471546:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787764798.471556:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc5d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2348:x1874607164365184:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 45us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764798.471564:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 186 00010000:00010000:0.0:1787764798.935264:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764799.703408:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787764799.703437:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfbc3077c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176974592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787764799.703511:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764799.703631:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcffb59e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3289:1874607176974720:0@lo:400:kworker.0 00000100:00100000:0.0:1787764799.703649:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced26f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607176975104:0@lo:400:kworker.0 00000100:00100000:2.0:1787764799.703660:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764799.703688:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced26cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607176975232:0@lo:400:kworker.0 00000100:00100000:0.0:1787764799.703695:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764799.703727:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764799.703740:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced26d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607176974848:0@lo:400:kworker.0 00000100:00100000:0.0:1787764799.703775:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764799.703781:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176974720 00000100:00100000:2.0:1787764799.703788:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176974720 00000100:00100000:0.0:1787764799.703798:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787764799.703807:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced26f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607176974976:0@lo:400:kworker.0 00000100:00100000:2.0:1787764799.703836:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787764799.703837:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764799.703849:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc5d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3289:x1874607176974720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764799.703856:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176975232 00000100:00100000:3.0:1787764799.703863:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176975232 00000100:00100000:0.0:1787764799.703876:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176975104 00000100:00100000:0.0:1787764799.703894:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176975104 00000100:00100000:2.0:1787764799.703900:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc5d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3289:x1874607176974720:12345-0@lo:400:kworker.0 Request processed in 54us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764799.703907:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787764799.703908:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176974848 00000100:00100000:3.0:1787764799.703913:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176974848 00000100:00100000:3.0:1787764799.703935:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176974976 00000100:00100000:3.0:1787764799.703939:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176974976 00000100:00100000:0.0:1787764799.703942:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787764799.703955:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced26e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607176975104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764799.703964:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787764799.703968:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcffb59e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3289:1874607176974720:0@lo:400:kworker.0 00000100:00100000:3.0:1787764799.703977:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc668fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607176975232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764799.704008:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787764799.704016:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced26e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607176975104:12345-0@lo:400:kworker.0 Request processed in 64us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764799.704019:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced26c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607176974848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764799.704028:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787764799.704044:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc668fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607176975232:12345-0@lo:400:kworker.0 Request processed in 69us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764799.704053:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787764799.704056:0:5809:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1787764799.704064:0:5809:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1787764799.704075:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787764799.704077:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced26c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607176974848:12345-0@lo:400:kworker.0 Request processed in 61us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764799.704112:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaa49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607176974976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764799.704125:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787764799.704156:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaa49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607176974976:12345-0@lo:400:kworker.0 Request processed in 47us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764799.704165:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1787764799.704172:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787764799.704178:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787764799.704202:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced26cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607176975232:0@lo:400:kworker.0 00010000:00080000:0.0:1787764799.704252:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfced26f840 x1874607176975104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764799.704276:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced26f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607176975104:0@lo:400:kworker.0 00000100:00100000:0.0:1787764799.704302:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced26f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607176974976:0@lo:400:kworker.0 00000100:00100000:0.0:1787764799.704311:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced26d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607176974848:0@lo:400:kworker.0 00000100:00100000:1.0:1787764799.704526:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176974592 00000100:00100000:1.0:1787764799.704531:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176974592 00000100:00100000:1.0:1787764799.704575:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787764799.704583:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc668de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176974592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787764799.704607:0:6656:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787764799.704657:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc668de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176974592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764799.704664:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787764799.704936:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787764799.704950:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfbc3077c00 x1874607176974592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764815 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764799.704967:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfbc3077c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176974592:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787764799.960198:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764800.983274:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764802.008743:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764802.775283:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176975360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787764802.775353:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764802.775429:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176975360 00000100:00100000:2.0:1787764802.775438:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176975360 00000100:00080000:3.0:1787764802.775488:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787764802.775499:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787764802.775510:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaa4b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607176975360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787764802.775552:0:6655:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787764802.775610:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaa4b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607176975360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764802.775618:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787764802.775653:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcc668e580 x1874607176975360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764802.775672:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176975360:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787764803.031270:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764803.591215:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1787764803.591388:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1787764803.591424:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1787764803.591465:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1787764803.591587:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164365824 00000100:00100000:2.0:1787764803.591596:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164365824 00000100:00100000:1.0:1787764803.591622:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164365696 00000100:00100000:1.0:1787764803.591628:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164365696 00000100:00100000:3.0:1787764803.591629:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164365952 00000100:00100000:3.0:1787764803.591636:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164365952 00000100:00100000:1.0:1787764803.591689:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 188 00000100:00100000:1.0:1787764803.591701:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc5d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2348:x1874607164365696:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1787764803.591723:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 25 00000100:00100000:2.0:1787764803.591734:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaa48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2348:x1874607164365824:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1787764803.591785:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaa48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2348:x1874607164365824:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 54us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764803.591792:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 25 00000100:00100000:1.0:1787764803.591821:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc5d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2348:x1874607164365696:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 121us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764803.591831:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 188 00000100:00100000:2.0:1787764803.591836:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164366080 00000100:00100000:2.0:1787764803.591842:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164366080 00000100:00100000:3.0:1787764803.591859:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 14 00000100:00100000:3.0:1787764803.591870:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaa49680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+5:2348:x1874607164365952:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1787764803.591895:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 15 00000100:00100000:3.0:1787764803.591908:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaa49680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+5:2348:x1874607164365952:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 39us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764803.591909:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaa4a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+5:2348:x1874607164366080:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1787764803.591924:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 14 00000100:00100000:2.0:1787764803.591952:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaa4a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+5:2348:x1874607164366080:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 48us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764803.591961:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 15 00000100:00080000:0.0:1787764803.592316:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787764803.592322:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787764803.592329:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787764804.055279:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787764804.823256:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced7cd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3287:1874607176975488:0@lo:400:kworker.0 00000100:00100000:0.0:1787764804.823315:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced7cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1874607176975616:0@lo:400:kworker.0 00000100:00100000:2.0:1787764804.823332:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced7cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176975872:0@lo:400:kworker.0 00000100:00100000:1.0:1787764804.823341:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764804.823349:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764804.823380:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764804.823412:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced7ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1874607176975744:0@lo:400:kworker.0 00000100:00100000:2.0:1787764804.823422:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176975488 00000100:00100000:2.0:1787764804.823427:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176975488 00000100:00100000:0.0:1787764804.823444:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764804.823466:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787764804.823474:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc5d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3287:x1874607176975488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764804.823475:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176975616 00000100:00100000:0.0:1787764804.823481:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176975616 00000100:00100000:0.0:1787764804.823521:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176975744 00000100:00100000:0.0:1787764804.823525:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176975744 00000100:00100000:2.0:1787764804.823527:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc5d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3287:x1874607176975488:12345-0@lo:400:kworker.0 Request processed in 52us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764804.823536:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787764804.823539:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced7cd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3287:1874607176975488:0@lo:400:kworker.0 00000100:00100000:0.0:1787764804.823556:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787764804.823563:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced7ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1874607176976000:0@lo:400:kworker.0 00000100:00100000:0.0:1787764804.823564:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced7cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1874607176975616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764804.823572:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176975872 00000100:00100000:2.0:1787764804.823576:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176975872 00000100:00100000:1.0:1787764804.823594:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764804.823599:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced7cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1874607176975616:12345-0@lo:400:kworker.0 Request processed in 37us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764804.823609:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787764804.823610:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787764804.823621:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc668c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607176975872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764804.823626:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176976000 00000100:00100000:0.0:1787764804.823631:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176976000 00000100:00100000:0.0:1787764804.823658:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787764804.823658:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc668c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607176975872:12345-0@lo:400:kworker.0 Request processed in 38us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764804.823666:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787764804.823670:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced7ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1874607176975744:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1787764804.823683:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfced7cc780 x1874607176975872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764804.823692:0:9173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787764804.823698:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced7cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176975872:0@lo:400:kworker.0 00000100:00100000:2.0:1787764804.823705:0:9173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaa921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1874607176976000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764804.823715:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced7ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1874607176975744:12345-0@lo:400:kworker.0 Request processed in 47us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764804.823722:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1787764804.823744:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787764804.823749:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787764804.823752:0:9173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaa921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1874607176976000:12345-0@lo:400:kworker.0 Request processed in 51us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764804.823761:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced7ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1874607176976000:0@lo:400:kworker.0 00000100:00100000:2.0:1787764804.823774:0:9173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787764804.823989:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced7ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1874607176975744:0@lo:400:kworker.0 00000100:00100000:0.0:1787764804.824012:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced7cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1874607176975616:0@lo:400:kworker.0 00000100:00100000:0.0:1787764804.824017:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced7ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607176976128:0@lo:400:kworker.0 00000100:00100000:0.0:1787764804.824051:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764804.824112:0:6794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176976128 00000100:00100000:2.0:1787764804.824116:0:6794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176976128 00000100:00100000:2.0:1787764804.824148:0:6794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787764804.824156:0:6794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced7ce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607176976128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764804.824199:0:6794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced7ce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607176976128:12345-0@lo:400:kworker.0 Request processed in 45us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764804.824206:0:6794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1787764804.824272:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfced7ccf00 x1874607176976128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764804.824283:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced7ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607176976128:0@lo:400:kworker.0 00000100:00100000:0.0:1787764804.824296:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787764804.824303:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc668e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607176976256:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787764804.824318:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787764804.824332:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764804.824364:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176976256 00000100:00100000:2.0:1787764804.824369:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176976256 00000100:00100000:2.0:1787764804.824398:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787764804.824404:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced7ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607176976256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787764804.824427:0:6656:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787764804.824459:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced7ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607176976256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764804.824463:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1787764804.824487:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcc668e940 x1874607176976256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764820 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764804.824503:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc668e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607176976256:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1787764804.941117:0:9212:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.118 00010000:00010000:0.0:1787764805.079553:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764806.103524:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787764806.606168:0:9310:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.118 00010000:00010000:0.0:1787764807.127273:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787764807.895308:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced7ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176976384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787764807.895373:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764807.895422:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176976384 00000100:00100000:0.0:1787764807.895435:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176976384 00000100:00080000:2.0:1787764807.895471:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787764807.895501:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787764807.895513:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcf522d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607176976384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787764807.895544:0:6655:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787764807.895602:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcf522d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607176976384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764807.895609:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787764807.895637:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfced7ce1c0 x1874607176976384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764807.895657:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced7ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176976384:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787764808.151201:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787764808.344258:0:9407:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.118 00000100:00100000:1.0:1787764808.708672:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1787764808.708725:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1787764808.708740:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164366208 00000100:00100000:2.0:1787764808.708749:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164366208 00000100:00100000:0.0:1787764808.708793:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164366336 00000100:00100000:0.0:1787764808.708803:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164366336 00000100:00100000:2.0:1787764808.708816:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 190 00000100:00100000:2.0:1787764808.708825:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc5d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2345:x1874607164366208:12345-192.168.202.53@tcp:400:kworker.0 00000100:00080000:1.0:1787764808.708860:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787764808.708874:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 29 00000100:00100000:0.0:1787764808.708886:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcf522c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2345:x1874607164366336:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1787764808.708890:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc5d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2345:x1874607164366208:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 65us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764808.708896:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 190 00000100:00100000:0.0:1787764808.708942:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcf522c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2345:x1874607164366336:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 58us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764808.708950:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 29 00000100:00100000:1.0:1787764808.710747:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1787764808.710815:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164366464 00000100:00100000:2.0:1787764808.710829:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164366464 00000100:00100000:1.0:1787764808.710860:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00080000:3.0:1787764808.710879:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787764808.710888:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164366592 00000100:00100000:2.0:1787764808.710893:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164366592 00000100:00100000:0.0:1787764808.710925:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 11 00000100:00100000:2.0:1787764808.710934:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 12 00000100:00100000:0.0:1787764808.710939:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcf522e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c035addb-e6b1-4a9c-9554-21f3e0d84883+5:2344:x1874607164366464:12345-192.168.202.53@tcp:9:kworker.0 00000100:00100000:2.0:1787764808.710952:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcf522de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+5:2344:x1874607164366592:12345-192.168.202.53@tcp:9:kworker.0 00000100:00080000:3.0:1787764808.710952:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:0.0:1787764808.710971:0:6653:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf82b4f42fb37b46 00000020:00000080:2.0:1787764808.710983:0:6651:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf82b4f42fb37b4d 00000100:00080000:0.0:1787764808.710986:0:6653:0:(import.c:65:import_set_state_nolock()) ffff9dfbc313a000 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1787764808.710993:0:6651:0:(import.c:65:import_set_state_nolock()) ffff9dfbc1c36000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787764808.711017:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1787764808.711032:0:6653:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000001:00000004:2.0:1787764808.711038:0:6651:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:3.0:1787764808.711039:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764808.711517:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcf522de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+2:2344:x1874607164366592:12345-192.168.202.53@tcp:9:kworker.0 Request processed in 572us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764808.711525:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 12 00000100:00100000:0.0:1787764808.711681:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcf522e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c035addb-e6b1-4a9c-9554-21f3e0d84883+2:2344:x1874607164366464:12345-192.168.202.53@tcp:9:kworker.0 Request processed in 746us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764808.711689:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 11 00010000:00010000:0.0:1787764809.175379:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764809.943311:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfbc3074b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176976512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787764809.943387:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764809.943458:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcf522cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607176976896:0@lo:400:kworker.0 00000100:00100000:2.0:1787764809.943461:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcf522e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176977024:0@lo:400:kworker.0 00000100:00100000:1.0:1787764809.943511:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764809.943514:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764809.943559:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176976512 00000100:00100000:1.0:1787764809.943564:0:6794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176977024 00000100:00100000:2.0:1787764809.943567:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176976512 00000100:00100000:1.0:1787764809.943580:0:6794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176977024 00000100:00100000:1.0:1787764809.943635:0:6794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787764809.943645:0:6794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc668e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176977024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764809.943652:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787764809.943661:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc668e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176976512:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787764809.943698:0:6794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc668e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176977024:12345-0@lo:400:kworker.0 Request processed in 54us (188us total) trans 0 rc 0/0 00002000:00000024:2.0:1787764809.943700:0:6656:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787764809.943721:0:6794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1787764809.943755:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787764809.943759:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787764809.943782:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcf522e1c0 x1874607176977024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764809.943816:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcf522e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176977024:0@lo:400:kworker.0 00000100:00100000:2.0:1787764809.943914:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc668e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176976512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 253us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764809.943922:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787764809.943945:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcf522d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1874607176976768:0@lo:400:kworker.0 00000100:00100000:2.0:1787764809.943988:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764809.944025:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787764809.944042:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcf522f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3289:1874607176976640:0@lo:400:kworker.0 00000100:00100000:2.0:1787764809.944075:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764809.944238:0:9173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176976896 00000100:00100000:2.0:1787764809.944243:0:9173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176976896 00000100:00100000:2.0:1787764809.944281:0:9173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176976768 00000100:00100000:2.0:1787764809.944284:0:9173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176976768 00000100:00100000:2.0:1787764809.944306:0:9173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787764809.944314:0:9173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcf522ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607176976896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764809.944356:0:9173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcf522ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607176976896:12345-0@lo:400:kworker.0 Request processed in 43us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764809.944363:0:9173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787764809.944374:0:9173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787764809.944381:0:9173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaa492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1874607176976768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764809.944409:0:9173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaa492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1874607176976768:12345-0@lo:400:kworker.0 Request processed in 29us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764809.944417:0:9173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787764809.944438:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176976640 00000100:00100000:2.0:1787764809.944441:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176976640 00000100:00100000:2.0:1787764809.944465:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787764809.944473:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc5d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3289:x1874607176976640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764809.944504:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc5d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3289:x1874607176976640:12345-0@lo:400:kworker.0 Request processed in 33us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764809.944510:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787764809.944554:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcf522f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3289:1874607176976640:0@lo:400:kworker.0 00000100:00100000:2.0:1787764809.944560:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcf522f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607176977152:0@lo:400:kworker.0 00000100:00100000:2.0:1787764809.945135:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764809.945187:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcf522d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1874607176976768:0@lo:400:kworker.0 00000100:00100000:2.0:1787764809.945212:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176977152 00000100:00100000:2.0:1787764809.945215:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176977152 00000100:00100000:2.0:1787764809.945245:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787764809.945252:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffb59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607176977152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764809.945283:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffb59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607176977152:12345-0@lo:400:kworker.0 Request processed in 33us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764809.945296:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787764809.945323:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcf522f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607176977152:0@lo:400:kworker.0 00000100:00080000:2.0:1787764809.945383:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787764809.945455:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcf522cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607176976896:0@lo:400:kworker.0 00010000:00080000:1.0:1787764809.946556:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfbc3074b40 x1874607176976512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764825 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764809.946589:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfbc3074b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176976512:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1787764809.973977:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c035addb-e6b1-4a9c-9554-21f3e0d84883 00000020:00000080:2.0:1787764809.973987:0:7615:0:(genops.c:885:class_export_put()) final put ffff9dfbc1c34800/c035addb-e6b1-4a9c-9554-21f3e0d84883 00000020:00000080:0.0:1787764809.974056:0:478:0:(genops.c:844:class_export_destroy()) destroying export ffff9dfbc1c34800/c035addb-e6b1-4a9c-9554-21f3e0d84883 for lustre-OST0001 00000020:00000080:0.0:1787764809.974142:0:478:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dfbc1c36000 for lustre-OST0001 00010000:00010000:1.0:1787764810.199834:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764811.223266:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764812.247385:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764813.015332:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced7cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176977280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787764813.015413:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764813.015472:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176977280 00000100:00100000:0.0:1787764813.015480:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176977280 00000100:00080000:1.0:1787764813.015535:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787764813.015549:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787764813.015559:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaab6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176977280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787764813.015590:0:6656:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787764813.015646:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaab6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176977280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764813.015652:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1787764813.015743:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfced7cd680 x1874607176977280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764829 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764813.015760:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced7cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176977280:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787764813.271296:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787764813.536393:0:6683:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c035addb-e6b1-4a9c-9554-21f3e0d84883 00000020:00000080:3.0:1787764813.536403:0:6683:0:(genops.c:885:class_export_put()) final put ffff9dfbc313d000/c035addb-e6b1-4a9c-9554-21f3e0d84883 00000020:00000080:1.0:1787764813.536484:0:478:0:(genops.c:844:class_export_destroy()) destroying export ffff9dfbc313d000/c035addb-e6b1-4a9c-9554-21f3e0d84883 for lustre-OST0000 00000020:00000080:1.0:1787764813.536533:0:478:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dfbc313a000 for lustre-OST0000 00000100:00100000:1.0:1787764813.828829:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1787764813.828886:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164366720 00000100:00100000:2.0:1787764813.828896:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164366720 00000100:00100000:2.0:1787764813.828966:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 192 00000100:00100000:2.0:1787764813.828977:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2345:x1874607164366720:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1787764813.829049:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2345:x1874607164366720:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 75us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764813.829055:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 192 00000100:00100000:1.0:1787764813.829622:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1787764813.830066:0:9173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164366848 00000100:00100000:2.0:1787764813.830072:0:9173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164366848 00000100:00100000:2.0:1787764813.830196:0:9173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 33 00000100:00100000:2.0:1787764813.830204:0:9173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcf522e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2345:x1874607164366848:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1787764813.830266:0:9173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcf522e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2345:x1874607164366848:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 62us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764813.830274:0:9173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 33 00000100:00080000:1.0:1787764813.831253:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787764814.295666:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764815.063222:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787764815.063250:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfbc30761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176977408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787764815.063437:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764815.063519:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176977408 00000100:00100000:3.0:1787764815.063527:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176977408 00000100:00100000:3.0:1787764815.063597:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787764815.063615:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfbc3075680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176977408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787764815.063650:0:6656:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787764815.063710:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfbc3075680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176977408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764815.063719:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1787764815.063744:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787764815.063780:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfbc30761c0 x1874607176977408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764815.063806:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfbc30761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176977408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787764815.063863:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced7cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3287:1874607176977536:0@lo:400:kworker.0 00000100:00100000:3.0:1787764815.063904:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764815.063911:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced7ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1874607176977664:0@lo:400:kworker.0 00000100:00100000:3.0:1787764815.063946:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176977536 00000100:00100000:3.0:1787764815.063951:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176977536 00000100:00100000:0.0:1787764815.063967:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764815.063984:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1787764815.063994:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3287:x1874607176977536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764815.064006:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787764815.064016:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced7cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1874607176977792:0@lo:400:kworker.0 00000100:00100000:3.0:1787764815.064038:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3287:x1874607176977536:12345-0@lo:400:kworker.0 Request processed in 45us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764815.064046:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787764815.064051:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764815.064107:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176977664 00000100:00100000:0.0:1787764815.064112:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176977664 00000100:00100000:3.0:1787764815.064113:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced7cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3287:1874607176977536:0@lo:400:kworker.0 00000100:00100000:0.0:1787764815.064184:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176977792 00000100:00100000:0.0:1787764815.064188:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176977792 00000100:00100000:0.0:1787764815.064218:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787764815.064225:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced7cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1874607176977664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764815.064267:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced7cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1874607176977664:12345-0@lo:400:kworker.0 Request processed in 43us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764815.064274:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787764815.064287:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787764815.064294:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced7cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1874607176977792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764815.064325:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced7cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1874607176977792:12345-0@lo:400:kworker.0 Request processed in 33us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764815.064331:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1787764815.064350:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787764815.064369:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced7cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1874607176977792:0@lo:400:kworker.0 00000100:00100000:0.0:1787764815.064380:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced7ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1874607176977664:0@lo:400:kworker.0 00000100:00100000:3.0:1787764815.064498:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787764815.064510:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced7cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1874607176978048:0@lo:400:kworker.0 00000100:00100000:3.0:1787764815.064541:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764815.064570:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced7ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176977920:0@lo:400:kworker.0 00000100:00100000:3.0:1787764815.064599:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764815.064640:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176977920 00000100:00100000:3.0:1787764815.064644:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176977920 00000100:00100000:3.0:1787764815.064679:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787764815.064694:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfbc3074000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176977920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764815.064735:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfbc3074000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176977920:12345-0@lo:400:kworker.0 Request processed in 50us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764815.064740:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1787764815.064755:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787764815.064767:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfced7ce580 x1874607176977920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764815.064774:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced7ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176977920:0@lo:400:kworker.0 00000100:00100000:0.0:1787764815.064827:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176978048 00000100:00100000:0.0:1787764815.064832:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176978048 00000100:00100000:0.0:1787764815.064865:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787764815.064874:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfbc30761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1874607176978048:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787764815.064902:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787764815.064917:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfbc30761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1874607176978048:12345-0@lo:400:kworker.0 Request processed in 44us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764815.064931:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787764815.064994:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced7cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1874607176978048:0@lo:400:kworker.0 00000001:02000400:3.0:1787764815.243786:0:9458:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-compr ============----- Wed Aug 26 13:20:13 EDT 2026 00010000:00010000:0.0:1787764815.320189:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764816.343243:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764817.367193:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764818.138335:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787764818.138365:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced7cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176978176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787764818.138464:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764818.138546:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176978176 00000100:00100000:0.0:1787764818.138555:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176978176 00000100:00100000:0.0:1787764818.138625:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787764818.138637:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced7cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176978176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787764818.138682:0:6656:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787764818.138735:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced7cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176978176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764818.138743:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1787764818.138766:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787764818.138799:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfced7cc000 x1874607176978176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764834 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764818.138818:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced7cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176978176:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787764818.400238:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764818.947984:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764818.948030:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1787764818.948038:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164367104 00000100:00100000:0.0:1787764818.948048:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164367104 00000100:00100000:2.0:1787764818.948075:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164366976 00000100:00100000:2.0:1787764818.948112:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164366976 00000100:00080000:3.0:1787764818.948141:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787764818.948154:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 194 00000100:00100000:0.0:1787764818.948159:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 37 00000100:00100000:2.0:1787764818.948166:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2345:x1874607164366976:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1787764818.948174:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfbc3076580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2346:x1874607164367104:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1787764818.948226:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2345:x1874607164366976:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 62us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764818.948230:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfbc3076580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2346:x1874607164367104:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 60us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764818.948236:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 194 00000100:00100000:0.0:1787764818.948245:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 37 00010000:00010000:2.0:1787764819.415252:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787764820.183332:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcf522c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3289:1874607176978304:0@lo:400:kworker.0 00000100:00100000:2.0:1787764820.183384:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcf522cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607176978688:0@lo:400:kworker.0 00000100:00100000:1.0:1787764820.183409:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764820.183511:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcf522fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1874607176978560:0@lo:400:kworker.0 00000100:00100000:0.0:1787764820.184013:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcf522da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607176978432:0@lo:400:kworker.0 00000100:00100000:2.0:1787764820.184664:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764820.184700:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcf522f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607176978816:0@lo:400:kworker.0 00000100:00100000:3.0:1787764820.184725:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176978304 00000100:00100000:3.0:1787764820.184735:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176978304 00000100:00100000:1.0:1787764820.184738:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764820.184795:0:6794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176978688 00000100:00100000:1.0:1787764820.184800:0:6794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176978688 00000100:00100000:3.0:1787764820.184805:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787764820.184819:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3289:x1874607176978304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764820.184824:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764820.184846:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcf522d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176978944:0@lo:400:kworker.0 00000100:00100000:1.0:1787764820.184855:0:6794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787764820.184865:0:6794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaab43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607176978688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764820.184888:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764820.184899:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3289:x1874607176978304:12345-0@lo:400:kworker.0 Request processed in 83us (1489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764820.184908:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787764820.184919:0:6794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaab43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607176978688:12345-0@lo:400:kworker.0 Request processed in 55us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764820.184932:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176978816 00000100:00100000:1.0:1787764820.184937:0:6794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787764820.184939:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176978816 00000100:00100000:1.0:1787764820.184955:0:6794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176978944 00000100:00100000:1.0:1787764820.184960:0:6794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176978944 00000100:00100000:0.0:1787764820.184977:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176978432 00000100:00100000:0.0:1787764820.184982:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176978432 00000100:00100000:1.0:1787764820.184997:0:6794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787764820.185007:0:6794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced7cd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607176978944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764820.185013:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787764820.185024:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcf522f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607176978816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764820.185057:0:6794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced7cd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607176978944:12345-0@lo:400:kworker.0 Request processed in 52us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764820.185064:0:6794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787764820.185102:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcf522f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607176978816:12345-0@lo:400:kworker.0 Request processed in 51us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764820.185111:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787764820.185118:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764820.185141:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaab5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176979072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787764820.185179:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787764820.185196:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcf522cf00 x1874607176978688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764820.185212:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcf522cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607176978688:0@lo:400:kworker.0 00000100:00100000:0.0:1787764820.185503:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176978560 00000100:00100000:0.0:1787764820.185508:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176978560 00000100:00100000:1.0:1787764820.185512:0:9173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787764820.185519:0:9173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced7cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607176978432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764820.185535:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787764820.185546:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfbc30770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1874607176978560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764820.185549:0:9173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced7cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607176978432:12345-0@lo:400:kworker.0 Request processed in 30us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764820.185557:0:9173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787764820.185601:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfbc30770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1874607176978560:12345-0@lo:400:kworker.0 Request processed in 57us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764820.185608:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787764820.185641:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176979072 00000100:00100000:3.0:1787764820.185646:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcf522fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1874607176978560:0@lo:400:kworker.0 00000100:00100000:0.0:1787764820.185647:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176979072 00000100:00100000:0.0:1787764820.185684:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787764820.185688:0:6655:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1787764820.185694:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfbc3074b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176979072:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787764820.185697:0:6655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:3.0:1787764820.185716:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcf522da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607176978432:0@lo:400:kworker.0 00002000:00000024:0.0:1787764820.185726:0:6656:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:3.0:1787764820.185733:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcf522d680 x1874607176978944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764820.185745:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcf522d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176978944:0@lo:400:kworker.0 00000100:00100000:0.0:1787764820.185772:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfbc3074b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176979072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764820.185780:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcf522c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3289:1874607176978304:0@lo:400:kworker.0 00000100:00100000:0.0:1787764820.185794:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787764820.185798:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcf522f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607176978816:0@lo:400:kworker.0 00010000:00080000:0.0:1787764820.185827:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcdaab5a40 x1874607176979072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764836 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787764820.185828:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787764820.185834:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787764820.185838:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787764820.185843:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaab5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176979072:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787764820.440186:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764821.463362:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764822.487391:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764823.255458:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced7cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607176979200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787764823.255539:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764823.255614:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176979200 00000100:00100000:0.0:1787764823.255621:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176979200 00000100:00100000:0.0:1787764823.255690:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787764823.255700:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced7ced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607176979200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787764823.255736:0:6656:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787764823.255782:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced7ced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607176979200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764823.255790:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1787764823.255811:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787764823.255969:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfced7cde00 x1874607176979200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764839 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764823.255987:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced7cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607176979200:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787764823.511201:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764824.068016:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1787764824.068070:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1787764824.068117:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164367232 00000100:00100000:2.0:1787764824.068128:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164367232 00000100:00100000:1.0:1787764824.068136:0:9173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164367360 00000100:00100000:1.0:1787764824.068144:0:9173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164367360 00000100:00100000:2.0:1787764824.068181:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 196 00000100:00100000:2.0:1787764824.068195:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2345:x1874607164367232:12345-192.168.202.53@tcp:400:kworker.0 00000100:00080000:0.0:1787764824.068203:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787764824.068218:0:9173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 41 00000100:00100000:1.0:1787764824.068230:0:9173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced7ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2346:x1874607164367360:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1787764824.068267:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2345:x1874607164367232:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 75us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764824.068277:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 196 00000100:00100000:1.0:1787764824.068278:0:9173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced7ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2346:x1874607164367360:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 48us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764824.068305:0:9173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 41 00010000:00010000:0.0:1787764824.535406:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787764825.305257:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcf522f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3289:1874607176979328:0@lo:400:kworker.0 00000100:00100000:1.0:1787764825.305336:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764825.305388:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcf522da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607176979840:0@lo:400:kworker.0 00000100:00100000:1.0:1787764825.305417:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764825.305440:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcf522f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607176979456:0@lo:400:kworker.0 00000100:00100000:1.0:1787764825.305448:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787764825.305456:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcf522d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176979712:0@lo:400:kworker.0 00000100:00100000:3.0:1787764825.305482:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764825.305493:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764825.307185:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176979328 00000100:00100000:2.0:1787764825.307193:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176979328 00000100:00100000:2.0:1787764825.307238:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787764825.307247:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3289:x1874607176979328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764825.307371:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcf522c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1874607176979584:0@lo:400:kworker.0 00000100:00100000:1.0:1787764825.307430:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764825.307453:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcdaab7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176980096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787764825.307478:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764825.307516:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176979840 00000100:00100000:1.0:1787764825.307521:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176979840 00000100:00100000:1.0:1787764825.307554:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176979456 00000100:00100000:1.0:1787764825.307558:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176979456 00000100:00100000:1.0:1787764825.307573:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176979584 00000100:00100000:1.0:1787764825.307576:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176979584 00000100:00100000:1.0:1787764825.307591:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787764825.307597:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcf522cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607176979840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764825.307635:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcf522cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607176979840:12345-0@lo:400:kworker.0 Request processed in 38us (2217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764825.307642:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787764825.307656:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787764825.307660:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfbc3075a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607176979456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764825.307689:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfbc3075a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607176979456:12345-0@lo:400:kworker.0 Request processed in 29us (2209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764825.307693:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787764825.307700:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787764825.307704:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffb50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1874607176979584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764825.307721:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffb50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1874607176979584:12345-0@lo:400:kworker.0 Request processed in 17us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764825.307724:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787764825.307736:0:6794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176979712 00000100:00100000:1.0:1787764825.307738:0:6794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176979712 00000100:00100000:1.0:1787764825.307754:0:6794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787764825.307758:0:6794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfce0d721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176979712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764825.307775:0:6794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfce0d721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176979712:12345-0@lo:400:kworker.0 Request processed in 17us (2284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764825.307778:0:6794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1787764825.307790:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787764825.307793:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787764825.308078:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcf522c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1874607176979584:0@lo:400:kworker.0 00000100:00100000:3.0:1787764825.308159:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcf522f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607176979456:0@lo:400:kworker.0 00000100:00100000:3.0:1787764825.308170:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcf522fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176979968:0@lo:400:kworker.0 00000100:00100000:3.0:1787764825.308203:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764825.308262:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176979968 00000100:00100000:3.0:1787764825.308266:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176979968 00010000:00080000:1.0:1787764825.308279:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcf522d680 x1874607176979712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764825.308290:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcf522d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176979712:0@lo:400:kworker.0 00000100:00100000:1.0:1787764825.308302:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcf522da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607176979840:0@lo:400:kworker.0 00000100:00100000:3.0:1787764825.308640:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787764825.308673:0:9780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176980096 00000100:00100000:0.0:1787764825.308679:0:9780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176980096 00000100:00100000:0.0:1787764825.308710:0:9780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787764825.308713:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfbc30743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3286:x1874607176979968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764825.308721:0:9780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffb521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1874607176980096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787764825.308755:0:9780:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787764825.308774:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfbc30743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3286:x1874607176979968:12345-0@lo:400:kworker.0 Request processed in 67us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764825.308795:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787764825.308806:0:9780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffb521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1874607176980096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (1325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764825.308819:0:9780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787764825.308837:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3289:x1874607176979328:12345-0@lo:400:kworker.0 Request processed in 1591us (3501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764825.308844:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:2.0:1787764825.309099:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787764825.309582:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcdaab7840 x1874607176980096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764841 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764825.309601:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcdaab7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176980096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787764825.309641:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcf522f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3289:1874607176979328:0@lo:400:kworker.0 00010000:00080000:2.0:1787764825.310333:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcf522fc00 x1874607176979968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764825.310344:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcf522fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176979968:0@lo:400:kworker.0 00010000:00010000:1.0:1787764825.560405:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764826.583224:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764827.607263:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787764828.375252:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced7ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607176980224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787764828.375336:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764828.375396:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176980224 00000100:00100000:3.0:1787764828.375404:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176980224 00000100:00080000:0.0:1787764828.375445:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787764828.375467:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787764828.375476:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffb51680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607176980224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787764828.375521:0:6655:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787764828.375800:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffb51680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607176980224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 324us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764828.375809:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1787764828.375815:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfced7ce580 x1874607176980224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764844 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764828.375836:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced7ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607176980224:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787764828.631261:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787764829.189041:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1787764829.189130:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764829.189236:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164367488 00000100:00100000:3.0:1787764829.189246:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164367488 00000100:00100000:3.0:1787764829.189310:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 198 00000100:00100000:3.0:1787764829.189320:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2345:x1874607164367488:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1787764829.189379:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2345:x1874607164367488:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 61us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764829.189387:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 198 00000100:00100000:2.0:1787764829.189854:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164367616 00000100:00100000:2.0:1787764829.189860:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164367616 00000100:00100000:2.0:1787764829.189917:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 45 00000100:00100000:2.0:1787764829.189926:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffb50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2346:x1874607164367616:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1787764829.189980:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffb50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2346:x1874607164367616:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 55us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764829.189987:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 45 00000100:00080000:0.0:1787764829.190176:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787764829.655223:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764830.423300:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced7cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176980352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787764830.423372:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764830.423503:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfbc3077c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3286:1874607176980480:0@lo:400:kworker.0 00000100:00100000:3.0:1787764830.423540:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764830.423579:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced26f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1874607176980992:0@lo:400:kworker.0 00000100:00100000:2.0:1787764830.423604:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176980480 00000100:00100000:3.0:1787764830.423608:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764830.423611:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176980480 00000100:00100000:3.0:1787764830.423635:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787764830.423642:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfbc3074f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607176980608:0@lo:400:kworker.0 00000100:00100000:2.0:1787764830.423656:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787764830.423665:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3286:x1874607176980480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764830.423690:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764830.423691:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfbc3077840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1874607176980736:0@lo:400:kworker.0 00000100:00100000:3.0:1787764830.423713:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced26f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176981120:0@lo:400:kworker.0 00000100:00100000:2.0:1787764830.423727:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3286:x1874607176980480:12345-0@lo:400:kworker.0 Request processed in 63us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764830.423737:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764830.423738:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787764830.423743:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764830.423768:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787764830.423776:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced26d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607176980864:0@lo:400:kworker.0 00000100:00100000:1.0:1787764830.423801:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764830.423826:0:6794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176981120 00000100:00100000:1.0:1787764830.423829:0:6794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176981120 00000100:00100000:1.0:1787764830.423862:0:6794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176980864 00000100:00100000:1.0:1787764830.423864:0:6794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176980864 00000100:00100000:1.0:1787764830.423886:0:6794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787764830.423894:0:6794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc32fda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607176981120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764830.423968:0:6794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc32fda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607176981120:12345-0@lo:400:kworker.0 Request processed in 75us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764830.423976:0:6794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787764830.424034:0:9173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176980992 00000100:00100000:1.0:1787764830.424044:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787764830.424045:0:9173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176980992 00000100:00100000:1.0:1787764830.424054:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffb52580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607176980864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764830.424075:0:9173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176980608 00000100:00100000:1.0:1787764830.424111:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffb52580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607176980864:12345-0@lo:400:kworker.0 Request processed in 60us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764830.424119:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787764830.424122:0:9173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176980608 00000100:00100000:2.0:1787764830.424151:0:9173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176980736 00000100:00100000:2.0:1787764830.424155:0:9173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176980736 00000100:00100000:1.0:1787764830.424158:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787764830.424169:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced26cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1874607176980992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764830.424177:0:9173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787764830.424186:0:9173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc32ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607176980608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764830.424204:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced26cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1874607176980992:12345-0@lo:400:kworker.0 Request processed in 37us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764830.424211:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787764830.424228:0:9173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc32ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607176980608:12345-0@lo:400:kworker.0 Request processed in 42us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764830.424229:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787764830.424239:0:9173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787764830.424243:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffb530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1874607176980736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764830.424282:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffb530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1874607176980736:12345-0@lo:400:kworker.0 Request processed in 42us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764830.424288:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1787764830.424401:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfced26d2c0 x1874607176980864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764830.424415:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced26d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607176980864:0@lo:400:kworker.0 00000100:00100000:1.0:1787764830.424429:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfbc3077840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1874607176980736:0@lo:400:kworker.0 00000100:00080000:1.0:1787764830.424465:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787764830.424466:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176980352 00000100:00080000:1.0:1787764830.424471:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787764830.424472:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176980352 00000100:00080000:1.0:1787764830.424474:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787764830.424501:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787764830.424506:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced7cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176980352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787764830.424526:0:6656:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787764830.424549:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced7cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176980352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764830.424553:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1787764830.425177:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfced7cc000 x1874607176980352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764846 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1787764830.425184:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfced26f840 x1874607176981120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764830.425200:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced7cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176980352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787764830.425201:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced26f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176981120:0@lo:400:kworker.0 00000100:00100000:3.0:1787764830.425222:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfbc3077c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3286:1874607176980480:0@lo:400:kworker.0 00000100:00100000:3.0:1787764830.425235:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced26f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1874607176980992:0@lo:400:kworker.0 00000100:00100000:3.0:1787764830.425253:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfbc3074f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607176980608:0@lo:400:kworker.0 00010000:00010000:0.0:1787764830.679255:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764831.703410:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764832.727196:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787764833.495400:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced7cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607176981248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787764833.495472:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764833.495705:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176981248 00000100:00100000:3.0:1787764833.495713:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176981248 00000100:00080000:0.0:1787764833.495784:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787764833.495797:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787764833.495807:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffb503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607176981248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787764833.495839:0:6655:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787764833.496029:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffb503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607176981248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 224us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764833.496036:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1787764833.496101:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfced7cc000 x1874607176981248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764833.496117:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced7cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607176981248:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787764833.754067:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764834.314775:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764834.314830:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1787764834.314940:0:9173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164367872 00000100:00100000:2.0:1787764834.314966:0:9173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164367872 00000100:00100000:2.0:1787764834.315061:0:9173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 49 00000100:00100000:2.0:1787764834.315072:0:9173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc32fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2345:x1874607164367872:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1787764834.315188:0:9173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc32fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2345:x1874607164367872:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 117us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764834.315195:0:9173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 49 00000100:00080000:0.0:1787764834.315780:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787764834.315868:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164367744 00000100:00100000:1.0:1787764834.315875:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164367744 00000100:00100000:1.0:1787764834.315930:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 200 00000100:00100000:1.0:1787764834.315939:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2345:x1874607164367744:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1787764834.316002:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2345:x1874607164367744:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 64us (1242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764834.316010:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 200 00010000:00010000:1.0:1787764834.775329:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787764835.171937:0:10186:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 1081 00000100:00100000:1.0:1787764835.543406:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787764835.543443:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc6b9cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607176981760:0@lo:400:kworker.0 00000100:00100000:3.0:1787764835.543443:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607176981504:0@lo:400:kworker.0 00000100:00100000:0.0:1787764835.543478:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc6b9ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1874607176981632:0@lo:400:kworker.0 00000100:00100000:3.0:1787764835.543638:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764835.543692:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764835.543857:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc6b9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607176981888:0@lo:400:kworker.0 00000100:00100000:2.0:1787764835.543892:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764835.543967:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc6b9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176982016:0@lo:400:kworker.0 00000100:00100000:0.0:1787764835.543988:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced7cd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176982144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787764835.544012:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764835.544032:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764835.544078:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176981504 00000100:00100000:3.0:1787764835.544102:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176981504 00000100:00100000:0.0:1787764835.544110:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176981632 00000100:00100000:0.0:1787764835.544116:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176981632 00000100:00100000:3.0:1787764835.544147:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176981888 00000100:00100000:3.0:1787764835.544151:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176981888 00000100:00100000:0.0:1787764835.544166:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787764835.544179:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc6b9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607176981504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764835.544180:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787764835.544190:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced7cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1874607176981632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764835.544256:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc6b9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607176981504:12345-0@lo:400:kworker.0 Request processed in 81us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764835.544264:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced7cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1874607176981632:12345-0@lo:400:kworker.0 Request processed in 74us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764835.544269:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787764835.544277:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787764835.544296:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787764835.544304:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaab4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607176981888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764835.544328:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaab4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607176981888:12345-0@lo:400:kworker.0 Request processed in 26us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764835.544385:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc6b9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607176981888:0@lo:400:kworker.0 00000100:00100000:2.0:1787764835.544432:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176982016 00000100:00100000:2.0:1787764835.544435:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176982016 00000100:00100000:2.0:1787764835.544465:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787764835.544472:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc6b9d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607176982016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764835.544500:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc6b9d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607176982016:12345-0@lo:400:kworker.0 Request processed in 29us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764835.544506:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787764835.545073:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607176981504:0@lo:400:kworker.0 00010000:00080000:2.0:1787764835.545178:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcc6b9cb40 x1874607176982016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764835.545191:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc6b9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176982016:0@lo:400:kworker.0 00000100:00100000:1.0:1787764835.545218:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764835.545270:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176981760 00000100:00100000:2.0:1787764835.545274:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176981760 00000100:00100000:2.0:1787764835.545310:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787764835.545318:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffb53c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607176981760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764835.545360:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffb53c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607176981760:12345-0@lo:400:kworker.0 Request processed in 43us (143us total) trans 0 rc 0/0 00010000:00080000:1.0:1787764835.545366:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcc6b9cf00 x1874607176981760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764835.545370:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787764835.545384:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc6b9cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607176981760:0@lo:400:kworker.0 00000100:00100000:1.0:1787764835.545394:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3288:1874607176981376:0@lo:400:kworker.0 00000100:00100000:1.0:1787764835.545435:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764835.545497:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176981376 00000100:00100000:1.0:1787764835.545502:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176981376 00000100:00100000:1.0:1787764835.545550:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787764835.545560:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc3628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3288:x1874607176981376:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787764835.545578:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787764835.545584:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787764835.545587:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787764835.545601:0:9780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176982144 00000100:00100000:2.0:1787764835.545605:0:9780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176982144 00000100:00100000:1.0:1787764835.545608:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc3628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3288:x1874607176981376:12345-0@lo:400:kworker.0 Request processed in 49us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764835.545618:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1787764835.545635:0:9780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787764835.545644:0:9780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced7cde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176982144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787764835.545684:0:9780:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787764835.545719:0:9780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced7cde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176982144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (1689us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764835.545727:0:9780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787764835.545756:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc6b9ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1874607176981632:0@lo:400:kworker.0 00010000:00080000:2.0:1787764835.545767:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfced7cd2c0 x1874607176982144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764851 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764835.545784:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced7cd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176982144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787764835.545819:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3288:1874607176981376:0@lo:400:kworker.0 00000100:00100000:0.0:1787764835.546045:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00010000:3.0:1787764835.799300:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787764836.255629:0:10235:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-compr: start setup 13:20:35 (1787764835) === 00010000:00010000:0.0:1787764836.823211:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764837.847260:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787764838.615217:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcffb51e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607176982272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787764838.615300:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764838.615341:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176982272 00000100:00100000:3.0:1787764838.615351:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176982272 00000100:00080000:0.0:1787764838.615391:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787764838.615524:0:9780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787764838.615536:0:9780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffb52940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607176982272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787764838.615572:0:9780:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787764838.615625:0:9780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffb52940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607176982272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764838.615635:0:9780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1787764838.615657:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcffb51e00 x1874607176982272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764838.615673:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcffb51e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607176982272:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787764838.872237:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764839.428251:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764839.428314:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1787764839.428374:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164368000 00000100:00100000:1.0:1787764839.428384:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164368000 00000100:00100000:1.0:1787764839.428447:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 202 00000100:00100000:1.0:1787764839.428457:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc3629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2347:x1874607164368000:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1787764839.428533:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc3629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2347:x1874607164368000:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 76us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764839.428541:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 202 00000100:00100000:2.0:1787764839.428586:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164368128 00000100:00100000:2.0:1787764839.428591:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164368128 00000100:00100000:2.0:1787764839.428643:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 53 00000100:00100000:2.0:1787764839.428649:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc6b9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2347:x1874607164368128:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1787764839.428681:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc6b9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2347:x1874607164368128:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 32us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764839.428687:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 53 00000100:00080000:1.0:1787764839.428854:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787764839.895951:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764840.663321:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced7ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176982400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787764840.663403:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcffb52d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1874607176982656:0@lo:400:kworker.0 00000100:00100000:0.0:1787764840.663414:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764840.663475:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764840.663517:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcffb53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176983168:0@lo:400:kworker.0 00000100:00100000:0.0:1787764840.663518:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcffb53840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176982912:0@lo:400:kworker.0 00000100:00100000:1.0:1787764840.663570:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764840.663594:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcffb50f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1874607176982784:0@lo:400:kworker.0 00000100:00100000:1.0:1787764840.663631:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787764840.663640:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764840.663642:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcffb50780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3287:1874607176982528:0@lo:400:kworker.0 00000100:00100000:0.0:1787764840.663695:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764840.663701:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764840.663747:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcffb51e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1874607176983040:0@lo:400:kworker.0 00000100:00100000:0.0:1787764840.663748:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176982528 00000100:00100000:0.0:1787764840.663755:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176982528 00000100:00100000:1.0:1787764840.663783:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764840.663819:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787764840.663826:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176982656 00000100:00100000:2.0:1787764840.663828:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176982400 00000100:00100000:0.0:1787764840.663836:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3287:x1874607176982528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764840.663841:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176982656 00000100:00100000:1.0:1787764840.663842:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176982784 00000100:00100000:2.0:1787764840.663842:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176982400 00000100:00100000:1.0:1787764840.663859:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176982784 00000100:00100000:0.0:1787764840.663914:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3287:x1874607176982528:12345-0@lo:400:kworker.0 Request processed in 85us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764840.663921:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787764840.663930:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176983040 00000100:00100000:2.0:1787764840.663935:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787764840.663940:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787764840.663953:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffb512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1874607176982656:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787764840.663958:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787764840.663968:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787764840.663993:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcffb50780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3287:1874607176982528:0@lo:400:kworker.0 00000100:00100000:3.0:1787764840.664007:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176983040 00000100:00100000:1.0:1787764840.664008:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffb512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1874607176982656:12345-0@lo:400:kworker.0 Request processed in 55us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764840.664015:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcffb52d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1874607176982656:0@lo:400:kworker.0 00000100:00100000:1.0:1787764840.664026:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1787764840.664064:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787764840.664070:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787764840.664120:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787764840.664131:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced7cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1874607176982784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764840.664142:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfbc3074f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1874607176983040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764840.664153:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176983168 00000100:00100000:0.0:1787764840.664159:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176983168 00000100:00100000:1.0:1787764840.664163:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176982912 00000100:00100000:1.0:1787764840.664169:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176982912 00000100:00100000:0.0:1787764840.664201:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787764840.664209:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffb51a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3287:x1874607176983168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764840.664225:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787764840.664238:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced7cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1874607176982784:12345-0@lo:400:kworker.0 Request processed in 155us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764840.664239:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfc215680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176982912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764840.664249:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfbc3074f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1874607176983040:12345-0@lo:400:kworker.0 Request processed in 110us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764840.664263:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffb51a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3287:x1874607176983168:12345-0@lo:400:kworker.0 Request processed in 45us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764840.664267:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787764840.664284:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787764840.664286:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787764840.664310:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfc215680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176982912:12345-0@lo:400:kworker.0 Request processed in 75us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764840.664319:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787764840.664330:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced7cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176982400:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787764840.664356:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1787764840.664359:0:6656:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787764840.664361:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcffb50f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1874607176982784:0@lo:400:kworker.0 00010000:00080000:1.0:1787764840.664381:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcffb53840 x1874607176982912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764840.664395:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcffb53840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176982912:0@lo:400:kworker.0 00000100:00100000:0.0:1787764840.664402:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcffb51e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1874607176983040:0@lo:400:kworker.0 00000100:00100000:2.0:1787764840.664406:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced7cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176982400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 389us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764840.664418:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1787764840.664419:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfced7ce580 x1874607176982400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764856 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787764840.664426:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcffb53480 x1874607176983168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764840.664438:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced7ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176982400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787764840.664441:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcffb53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176983168:0@lo:400:kworker.0 00010000:00010000:2.0:1787764840.919295:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764841.944227:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764842.969070:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764843.735299:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfbc3077c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607176983296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787764843.735371:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764843.735505:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176983296 00000100:00100000:3.0:1787764843.735513:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176983296 00000100:00100000:3.0:1787764843.735574:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787764843.735585:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfc214000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607176983296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787764843.735617:0:6655:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787764843.735676:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfc214000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607176983296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764843.735683:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1787764843.735717:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfbc3077c00 x1874607176983296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764859 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764843.735734:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfbc3077c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607176983296:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787764843.735824:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787764843.991766:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787764844.409606:0:10428:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:2.0:1787764844.551618:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1787764844.551717:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764844.552994:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164368256 00000100:00100000:3.0:1787764844.553010:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164368256 00000100:00100000:3.0:1787764844.553116:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 204 00000100:00100000:3.0:1787764844.553127:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc3629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2346:x1874607164368256:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1787764844.553227:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc3629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2346:x1874607164368256:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 102us (1510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764844.553237:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 204 00000100:00100000:0.0:1787764844.555382:0:9173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164368384 00000100:00100000:0.0:1787764844.555401:0:9173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164368384 00000100:00100000:0.0:1787764844.555537:0:9173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 57 00000100:00100000:0.0:1787764844.555550:0:9173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaab6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2346:x1874607164368384:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1787764844.555687:0:9173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaab6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2346:x1874607164368384:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 140us (4082us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764844.555697:0:9173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 57 00000100:00080000:1.0:1787764844.557264:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787764845.015304:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764845.791122:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc6b9fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3289:1874607176983424:0@lo:400:kworker.0 00000100:00100000:3.0:1787764845.791197:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764845.791245:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc6b9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607176983936:0@lo:400:kworker.0 00000100:00100000:3.0:1787764845.791271:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764845.791295:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787764845.791300:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc6b9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176983808:0@lo:400:kworker.0 00000100:00100000:3.0:1787764845.791323:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764845.791351:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc6b9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607176983552:0@lo:400:kworker.0 00000100:00100000:3.0:1787764845.791375:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764845.791392:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc6b9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176984064:0@lo:400:kworker.0 00000100:00100000:3.0:1787764845.791412:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764845.791439:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787764845.791444:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc6b9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607176983680:0@lo:400:kworker.0 00000100:00100000:3.0:1787764845.791465:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764845.791494:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176983424 00000100:00100000:3.0:1787764845.791500:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176983424 00000100:00100000:3.0:1787764845.791541:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787764845.791550:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc3628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3289:x1874607176983424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764845.791598:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc3628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3289:x1874607176983424:12345-0@lo:400:kworker.0 Request processed in 48us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764845.791605:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787764845.791632:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176983936 00000100:00100000:3.0:1787764845.791635:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176983936 00000100:00100000:3.0:1787764845.791667:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176983552 00000100:00100000:3.0:1787764845.791669:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176983552 00000100:00100000:3.0:1787764845.791683:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176983680 00000100:00100000:3.0:1787764845.791686:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176983680 00000100:00100000:3.0:1787764845.791699:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787764845.791705:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc6b9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607176983936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764845.791734:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc6b9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607176983936:12345-0@lo:400:kworker.0 Request processed in 29us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764845.791739:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787764845.791749:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787764845.791755:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc6b9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607176983552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764845.791782:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc6b9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607176983552:12345-0@lo:400:kworker.0 Request processed in 27us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764845.791787:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787764845.791797:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787764845.791802:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc6b9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607176983680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764845.791834:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc6b9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607176983680:12345-0@lo:400:kworker.0 Request processed in 31us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764845.791840:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787764845.791872:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176983808 00000100:00100000:3.0:1787764845.791875:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176983808 00000100:00100000:3.0:1787764845.791899:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176984064 00000100:00100000:3.0:1787764845.791902:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176984064 00000100:00100000:3.0:1787764845.791919:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787764845.791925:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc6b9e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176983808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764845.791955:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc6b9e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176983808:12345-0@lo:400:kworker.0 Request processed in 30us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764845.791961:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787764845.791972:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787764845.791978:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc6b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607176984064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764845.792005:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc6b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607176984064:12345-0@lo:400:kworker.0 Request processed in 28us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764845.792012:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1787764845.792037:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787764845.792041:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787764845.792043:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787764845.792076:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcc6b9d2c0 x1874607176983808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764845.792107:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc6b9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176983808:0@lo:400:kworker.0 00000100:00100000:3.0:1787764845.792118:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc6b9fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3289:1874607176983424:0@lo:400:kworker.0 00000100:00100000:3.0:1787764845.792127:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc6b9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607176983936:0@lo:400:kworker.0 00000100:00100000:3.0:1787764845.792169:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc6b9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607176983680:0@lo:400:kworker.0 00000100:00100000:3.0:1787764845.792178:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc6b9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607176983552:0@lo:400:kworker.0 00010000:00080000:3.0:1787764845.792187:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcc6b9e940 x1874607176984064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764845.792194:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc6b9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176984064:0@lo:400:kworker.0 00000100:00100000:0.0:1787764845.793974:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcfc2170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176984192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787764845.794018:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764845.794559:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176984192 00000100:00100000:2.0:1787764845.794566:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176984192 00000100:00100000:2.0:1787764845.794647:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787764845.794673:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfc216580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176984192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787764845.794714:0:6656:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787764845.794760:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfc216580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176984192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764845.794766:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1787764845.795024:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcfc2170c0 x1874607176984192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764861 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764845.795039:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcfc2170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176984192:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787764846.039278:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764847.063407:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764848.088365:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764848.856054:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787764848.856112:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfbc3077840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176984320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787764848.856208:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764848.856601:0:9780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176984320 00000100:00100000:1.0:1787764848.856611:0:9780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176984320 00000100:00100000:1.0:1787764848.856681:0:9780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787764848.856693:0:9780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfc2170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176984320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787764848.856760:0:9780:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787764848.856837:0:9780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfc2170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176984320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764848.856845:0:9780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1787764848.856934:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfbc3077840 x1874607176984320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764864 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764848.856955:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfbc3077840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176984320:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787764848.857219:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787764849.112048:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764849.669383:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1787764849.669418:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764849.669467:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164368640 00000100:00100000:3.0:1787764849.669478:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164368640 00000100:00100000:1.0:1787764849.669491:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164368512 00000100:00100000:1.0:1787764849.669497:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164368512 00000100:00080000:0.0:1787764849.669555:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787764849.669561:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 206 00000100:00100000:3.0:1787764849.669562:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 61 00000100:00100000:1.0:1787764849.669579:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2345:x1874607164368512:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1787764849.669580:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaab5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2345:x1874607164368640:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1787764849.669658:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2345:x1874607164368512:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 86us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764849.669666:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaab5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2345:x1874607164368640:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 90us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764849.669673:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 206 00000100:00100000:3.0:1787764849.669681:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 61 00010000:00010000:1.0:1787764850.135262:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787764850.903927:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787764850.903950:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfbc3077840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607176984448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787764850.904016:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764850.904094:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176984448 00000100:00100000:1.0:1787764850.904100:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176984448 00000100:00100000:1.0:1787764850.904145:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787764850.904155:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfbc3077c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607176984448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787764850.904187:0:6655:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787764850.904232:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfbc3077c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607176984448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764850.904240:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1787764850.904293:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfbc3077840 x1874607176984448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764866 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764850.904311:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfbc3077840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607176984448:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787764850.904352:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787764850.904411:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced26f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1874607176984832:0@lo:400:kworker.0 00000100:00100000:1.0:1787764850.904437:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764850.904452:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787764850.904456:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced26f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607176984960:0@lo:400:kworker.0 00000100:00100000:1.0:1787764850.904476:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764850.904537:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfbc3077840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3286:1874607176984576:0@lo:400:kworker.0 00000100:00100000:1.0:1787764850.904561:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764850.904578:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced26d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1874607176985088:0@lo:400:kworker.0 00000100:00100000:1.0:1787764850.904594:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764850.904609:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787764850.904614:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced7ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607176984704:0@lo:400:kworker.0 00000100:00100000:1.0:1787764850.904633:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764850.904962:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176984960 00000100:00100000:2.0:1787764850.904968:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176984960 00000100:00100000:2.0:1787764850.905000:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787764850.905007:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcf522fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607176984960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764850.905281:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcf522fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607176984960:12345-0@lo:400:kworker.0 Request processed in 274us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764850.905289:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1787764850.905343:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfced26f840 x1874607176984960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764850.905357:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced26f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607176984960:0@lo:400:kworker.0 00000100:00100000:2.0:1787764850.905391:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176984576 00000100:00100000:2.0:1787764850.905394:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176984576 00000100:00100000:2.0:1787764850.905429:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787764850.905436:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3286:x1874607176984576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764850.905471:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3286:x1874607176984576:12345-0@lo:400:kworker.0 Request processed in 35us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764850.905478:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00080000:2.0:1787764850.905508:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787764850.905526:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfbc3077840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3286:1874607176984576:0@lo:400:kworker.0 00000100:00100000:1.0:1787764850.906633:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176984832 00000100:00100000:1.0:1787764850.906639:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176984832 00000100:00100000:1.0:1787764850.906669:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176985088 00000100:00100000:1.0:1787764850.906672:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176985088 00000100:00100000:1.0:1787764850.906702:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176984704 00000100:00100000:1.0:1787764850.906705:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176984704 00000100:00100000:1.0:1787764850.906720:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787764850.906727:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcf522cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1874607176984832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764850.906764:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcf522cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1874607176984832:12345-0@lo:400:kworker.0 Request processed in 37us (2326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764850.906771:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787764850.906783:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787764850.906789:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcf522f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1874607176985088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764850.906841:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcf522f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1874607176985088:12345-0@lo:400:kworker.0 Request processed in 52us (2245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764850.906847:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787764850.906859:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787764850.906866:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcf522da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607176984704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764850.906891:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcf522da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607176984704:12345-0@lo:400:kworker.0 Request processed in 26us (2257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764850.906897:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1787764850.906909:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787764850.906926:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced7ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607176984704:0@lo:400:kworker.0 00000100:00100000:1.0:1787764850.906937:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced26d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1874607176985088:0@lo:400:kworker.0 00000100:00100000:1.0:1787764850.906962:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced26f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1874607176984832:0@lo:400:kworker.0 00010000:00010000:0.0:1787764851.161141:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764852.185057:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764853.207285:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764853.978313:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787764853.978445:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcf522f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176985216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787764853.978516:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764853.978629:0:9780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176985216 00000100:00100000:1.0:1787764853.978636:0:9780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176985216 00000100:00100000:1.0:1787764853.978697:0:9780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787764853.978707:0:9780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaab7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607176985216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787764853.978741:0:9780:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787764853.978803:0:9780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcdaab7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607176985216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764853.978810:0:9780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1787764853.978907:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcf522f840 x1874607176985216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764869 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764853.978924:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcf522f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176985216:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787764853.979007:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787764854.231228:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764854.789400:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764854.789447:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1787764854.789515:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164368768 00000100:00100000:0.0:1787764854.789524:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164368768 00000100:00100000:0.0:1787764854.789583:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 208 00000100:00100000:0.0:1787764854.789594:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc3628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2348:x1874607164368768:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1787764854.789664:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc3628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2348:x1874607164368768:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 71us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764854.789672:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 208 00000100:00100000:0.0:1787764854.789703:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164368896 00000100:00100000:0.0:1787764854.789706:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164368896 00000100:00100000:0.0:1787764854.789745:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 65 00000100:00100000:0.0:1787764854.789752:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc6b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2348:x1874607164368896:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1787764854.789793:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc6b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2348:x1874607164368896:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 42us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764854.789799:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 65 00000100:00080000:0.0:1787764854.789890:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787764855.255900:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764856.023872:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcfc217c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607176985344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787764856.023953:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764856.024028:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176985344 00000100:00100000:0.0:1787764856.024035:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176985344 00000100:00100000:0.0:1787764856.024110:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787764856.024121:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfc215a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607176985344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787764856.024156:0:6656:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787764856.024201:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfc215a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607176985344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764856.024209:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1787764856.024228:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787764856.024275:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcfc217c00 x1874607176985344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764872 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764856.024294:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcfc217c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607176985344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787764856.026214:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced26f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607176985600:0@lo:400:kworker.0 00000100:00100000:2.0:1787764856.026268:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764856.026300:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787764856.026306:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced26d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607176985728:0@lo:400:kworker.0 00000100:00100000:2.0:1787764856.026348:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764856.026404:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176985600 00000100:00100000:2.0:1787764856.026410:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176985600 00000100:00100000:2.0:1787764856.026448:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176985728 00000100:00100000:2.0:1787764856.026452:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176985728 00000100:00100000:2.0:1787764856.026480:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787764856.026489:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc32ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607176985600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764856.026541:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc32ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607176985600:12345-0@lo:400:kworker.0 Request processed in 52us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764856.026548:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787764856.026564:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787764856.026570:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc56c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607176985728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764856.026596:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc56c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607176985728:12345-0@lo:400:kworker.0 Request processed in 27us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764856.026602:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1787764856.026626:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787764856.026651:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced26d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607176985728:0@lo:400:kworker.0 00000100:00100000:2.0:1787764856.026661:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced26f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607176985600:0@lo:400:kworker.0 00000100:00100000:2.0:1787764856.026698:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfced26f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607176985856:0@lo:400:kworker.0 00000100:00100000:2.0:1787764856.026726:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764856.026771:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787764856.026777:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfbc3077840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3288:1874607176985472:0@lo:400:kworker.0 00000100:00100000:2.0:1787764856.026803:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764856.026828:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc32fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1874607176985984:0@lo:400:kworker.0 00000100:00100000:2.0:1787764856.026848:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764856.026874:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176985856 00000100:00100000:2.0:1787764856.026878:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176985856 00000100:00100000:2.0:1787764856.026919:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787764856.026925:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc56c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607176985856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764856.026960:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc56c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607176985856:12345-0@lo:400:kworker.0 Request processed in 36us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764856.026967:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787764856.026983:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176985472 00000100:00100000:2.0:1787764856.026986:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176985472 00000100:00100000:2.0:1787764856.027009:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787764856.027015:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc3628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3288:x1874607176985472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764856.027044:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc3628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3288:x1874607176985472:12345-0@lo:400:kworker.0 Request processed in 29us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764856.027050:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787764856.027071:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176985984 00000100:00100000:2.0:1787764856.027075:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176985984 00000100:00100000:2.0:1787764856.027117:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787764856.027122:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc56c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1874607176985984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764856.027150:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc56c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1874607176985984:12345-0@lo:400:kworker.0 Request processed in 28us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764856.027155:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1787764856.027173:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787764856.027175:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787764856.027189:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfbc3077840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3288:1874607176985472:0@lo:400:kworker.0 00000100:00100000:2.0:1787764856.027198:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc32fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1874607176985984:0@lo:400:kworker.0 00010000:00080000:2.0:1787764856.027207:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfced26f840 x1874607176985856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764856.027216:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfced26f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607176985856:0@lo:400:kworker.0 00010000:00010000:1.0:1787764856.279610:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764857.303446:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764858.327980:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764859.095351:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcf522f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176986112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787764859.095426:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764859.095524:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176986112 00000100:00100000:0.0:1787764859.095531:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176986112 00000100:00100000:0.0:1787764859.095588:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787764859.095598:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc6b9cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607176986112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787764859.095633:0:6655:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787764859.096819:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787764859.097548:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc6b9cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607176986112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1948us (2117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764859.097559:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1787764859.102240:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcf522f840 x1874607176986112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764875 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764859.102269:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcf522f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176986112:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787764859.351308:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764859.910009:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1787764859.910061:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1787764859.910120:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164369152 00000100:00100000:1.0:1787764859.910141:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164369152 00000100:00080000:2.0:1787764859.910179:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787764859.910198:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 69 00000100:00100000:1.0:1787764859.910206:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc56c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2346:x1874607164369152:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1787764859.910312:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc56c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2346:x1874607164369152:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 105us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764859.910321:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 69 00000100:00100000:3.0:1787764859.910447:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164369024 00000100:00100000:3.0:1787764859.910452:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164369024 00000100:00100000:3.0:1787764859.910492:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 210 00000100:00100000:3.0:1787764859.910500:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2345:x1874607164369024:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1787764859.910603:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2345:x1874607164369024:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 102us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764859.910611:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 210 00010000:00010000:0.0:1787764860.375658:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764861.143299:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc6b9fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1874607176986368:0@lo:400:kworker.0 00000100:00100000:3.0:1787764861.143326:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc6b9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3287:1874607176986240:0@lo:400:kworker.0 00000100:00100000:1.0:1787764861.143454:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc6b9cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1874607176986496:0@lo:400:kworker.0 00000100:00100000:3.0:1787764861.143496:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764861.143510:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764861.143553:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc6b9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1874607176986752:0@lo:400:kworker.0 00000100:00100000:3.0:1787764861.143578:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764861.143602:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcf522f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176987008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787764861.143611:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787764861.143618:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc6b9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176986624:0@lo:400:kworker.0 00000100:00100000:1.0:1787764861.143635:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764861.143661:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787764861.143666:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764861.143671:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc6b9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176986880:0@lo:400:kworker.0 00000100:00100000:3.0:1787764861.143696:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176986240 00000100:00100000:3.0:1787764861.143702:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176986240 00000100:00100000:1.0:1787764861.143728:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764861.143763:0:6794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176986624 00000100:00100000:1.0:1787764861.143767:0:6794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176986624 00000100:00100000:3.0:1787764861.143790:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1787764861.143800:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3287:x1874607176986240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764861.143802:0:6794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176986880 00000100:00100000:1.0:1787764861.143807:0:6794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176986880 00000100:00100000:1.0:1787764861.143834:0:6794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787764861.143845:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3287:x1874607176986240:12345-0@lo:400:kworker.0 Request processed in 45us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764861.143846:0:6794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc77ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176986624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764861.143856:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1787764861.143888:0:6794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc77ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176986624:12345-0@lo:400:kworker.0 Request processed in 46us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764861.143890:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176986496 00000100:00100000:3.0:1787764861.143895:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176986496 00000100:00100000:1.0:1787764861.143899:0:6794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787764861.143920:0:6794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787764861.143922:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176986752 00000100:00100000:3.0:1787764861.143924:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176986752 00000100:00100000:1.0:1787764861.143930:0:6794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced7ce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176986880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764861.143941:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787764861.143948:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcf522c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1874607176986496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764861.143965:0:6794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced7ce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176986880:12345-0@lo:400:kworker.0 Request processed in 38us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764861.143978:0:6794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787764861.143996:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcf522c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1874607176986496:12345-0@lo:400:kworker.0 Request processed in 47us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764861.144004:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:1.0:1787764861.144010:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcc6b9da40 x1874607176986880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764861.144023:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc6b9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176986880:0@lo:400:kworker.0 00000100:00100000:3.0:1787764861.144032:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787764861.144037:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc6b9cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1874607176986496:0@lo:400:kworker.0 00000100:00100000:3.0:1787764861.144040:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc6b9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1874607176986752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764861.144070:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc6b9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1874607176986752:12345-0@lo:400:kworker.0 Request processed in 33us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764861.144074:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787764861.144107:0:9780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176987008 00000100:00100000:1.0:1787764861.144111:0:9780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176987008 00010000:00080000:3.0:1787764861.144132:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcc6b9d2c0 x1874607176986624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764861.144140:0:9780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787764861.144144:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc6b9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176986624:0@lo:400:kworker.0 00000100:00100000:1.0:1787764861.144149:0:9780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcf522d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176987008:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787764861.144160:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc6b9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3287:1874607176986240:0@lo:400:kworker.0 00000100:00100000:3.0:1787764861.144172:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc6b9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1874607176986752:0@lo:400:kworker.0 00002000:00000024:1.0:1787764861.144174:0:9780:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787764861.144224:0:9780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcf522d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176987008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764861.144232:0:9780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1787764861.144265:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcf522f840 x1874607176987008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764877 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764861.144279:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcf522f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176987008:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787764861.144328:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787764861.144334:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787764861.144337:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787764861.144636:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764861.144667:0:9173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176986368 00000100:00100000:2.0:1787764861.144671:0:9173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176986368 00000100:00100000:2.0:1787764861.144722:0:9173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787764861.144730:0:9173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc56c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1874607176986368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764861.144768:0:9173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc56c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1874607176986368:12345-0@lo:400:kworker.0 Request processed in 39us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764861.144775:0:9173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787764861.144806:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc6b9fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1874607176986368:0@lo:400:kworker.0 00010000:00010000:2.0:1787764861.400265:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764862.424116:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764863.447314:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764864.215403:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcf522f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176987136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787764864.215483:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764864.215666:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176987136 00000100:00100000:0.0:1787764864.215702:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176987136 00000100:00100000:0.0:1787764864.215818:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787764864.215838:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc77dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607176987136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787764864.215874:0:6655:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787764864.215928:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc77dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607176987136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764864.215936:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1787764864.215993:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787764864.216038:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcf522f840 x1874607176987136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764880 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764864.216057:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcf522f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176987136:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787764864.471714:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787764864.658294:0:11126:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1787764865.028150:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1787764865.028211:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764865.028215:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164369280 00000100:00100000:3.0:1787764865.028227:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164369280 00000100:00100000:1.0:1787764865.028271:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164369408 00000100:00100000:1.0:1787764865.028277:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164369408 00000100:00100000:3.0:1787764865.028298:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 212 00000100:00100000:3.0:1787764865.028311:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2348:x1874607164369280:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1787764865.028332:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 73 00000100:00100000:1.0:1787764865.028350:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc56c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2347:x1874607164369408:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1787764865.028385:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2348:x1874607164369280:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 77us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764865.028394:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc56c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2347:x1874607164369408:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 52us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764865.028399:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 212 00000100:00100000:1.0:1787764865.028407:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 73 00000100:00080000:1.0:1787764865.028429:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787764865.495217:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764866.263262:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcf522f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176987264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787764866.263282:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc56c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607176987648:0@lo:400:kworker.0 00000100:00100000:2.0:1787764866.263311:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc56c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3288:1874607176987392:0@lo:400:kworker.0 00000100:00100000:3.0:1787764866.263335:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764866.263341:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764866.263356:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764866.263404:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc56c1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1874607176987904:0@lo:400:kworker.0 00000100:00100000:3.0:1787764866.263404:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc56c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176987776:0@lo:400:kworker.0 00000100:00100000:0.0:1787764866.263411:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176987264 00000100:00100000:1.0:1787764866.263412:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176987648 00000100:00100000:0.0:1787764866.263421:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176987264 00000100:00100000:1.0:1787764866.263421:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176987648 00000100:00100000:2.0:1787764866.263430:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764866.263430:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764866.263455:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787764866.263462:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc56c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1874607176987520:0@lo:400:kworker.0 00000100:00100000:1.0:1787764866.263490:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176987904 00000100:00100000:0.0:1787764866.263491:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787764866.263494:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176987904 00000100:00100000:3.0:1787764866.263501:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176987392 00000100:00100000:3.0:1787764866.263506:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176987392 00000100:00100000:2.0:1787764866.263509:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764866.263511:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc77de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176987264:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787764866.263525:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176987520 00000100:00100000:1.0:1787764866.263529:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176987520 00000100:00100000:2.0:1787764866.263539:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc56c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607176988032:0@lo:400:kworker.0 00000100:00100000:3.0:1787764866.263539:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1787764866.263549:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3288:x1874607176987392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764866.263552:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00002000:00000024:0.0:1787764866.263560:0:6656:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787764866.263566:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc6b9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607176987648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764866.263573:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764866.263596:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3288:x1874607176987392:12345-0@lo:400:kworker.0 Request processed in 49us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764866.263604:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1787764866.263619:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc56c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3288:1874607176987392:0@lo:400:kworker.0 00000100:00100000:1.0:1787764866.263630:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc6b9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607176987648:12345-0@lo:400:kworker.0 Request processed in 64us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764866.263631:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc77de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176987264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764866.263644:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787764866.263648:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787764866.263652:0:9173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787764866.263685:0:9173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc56c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1874607176987904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764866.263687:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787764866.263694:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc56c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1874607176987520:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787764866.263735:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787764866.263740:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787764866.263741:0:9173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc56c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1874607176987904:12345-0@lo:400:kworker.0 Request processed in 80us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764866.263741:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc56c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1874607176987520:12345-0@lo:400:kworker.0 Request processed in 46us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764866.263750:0:9173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787764866.263755:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787764866.263757:0:6794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176987776 00000100:00100000:1.0:1787764866.263762:0:6794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176987776 00000100:00100000:2.0:1787764866.263781:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176988032 00000100:00100000:2.0:1787764866.263786:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176988032 00000100:00100000:1.0:1787764866.263827:0:6794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787764866.263840:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787764866.263841:0:6794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc77dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176987776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764866.263853:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc56c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607176988032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764866.263896:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc56c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1874607176987520:0@lo:400:kworker.0 00000100:00100000:2.0:1787764866.263904:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc56c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607176988032:12345-0@lo:400:kworker.0 Request processed in 55us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764866.263906:0:6794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc77dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176987776:12345-0@lo:400:kworker.0 Request processed in 63us (468us total) trans 0 rc 0/0 00010000:00080000:3.0:1787764866.263912:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcc56c3480 x1874607176988032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764866.263916:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787764866.263923:0:6794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787764866.263925:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc56c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607176988032:0@lo:400:kworker.0 00000100:00100000:3.0:1787764866.263947:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc56c1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1874607176987904:0@lo:400:kworker.0 00000100:00080000:1.0:1787764866.263978:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787764866.264016:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcc56c3c00 x1874607176987776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764866.264026:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc56c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176987776:0@lo:400:kworker.0 00000100:00100000:3.0:1787764866.264038:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc56c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607176987648:0@lo:400:kworker.0 00010000:00080000:1.0:1787764866.264044:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcf522f840 x1874607176987264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764882 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764866.264059:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcf522f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176987264:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787764866.519264:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764867.543354:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764868.567363:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764869.335294:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc6b9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176988160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787764869.335426:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764869.335506:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176988160 00000100:00100000:2.0:1787764869.335512:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176988160 00000100:00080000:1.0:1787764869.335570:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787764869.335582:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787764869.335593:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc56c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607176988160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787764869.335649:0:6655:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787764869.335697:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc56c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607176988160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764869.335705:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1787764869.335797:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcc6b9f840 x1874607176988160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764885 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764869.335817:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc6b9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176988160:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787764869.591422:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764870.149312:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764870.149356:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1787764870.149511:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164369664 00000100:00100000:1.0:1787764870.149522:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164369664 00000100:00100000:0.0:1787764870.149644:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164369536 00000100:00100000:0.0:1787764870.149649:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164369536 00000100:00100000:1.0:1787764870.149669:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 77 00000100:00100000:1.0:1787764870.149682:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc77df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2348:x1874607164369664:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1787764870.149764:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc77df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2348:x1874607164369664:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 73us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764870.149772:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 77 00000100:00080000:3.0:1787764870.149934:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787764870.150046:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 214 00000100:00100000:0.0:1787764870.150062:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc362ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2348:x1874607164369536:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1787764870.150121:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc362ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2348:x1874607164369536:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 67us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764870.150128:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 214 00000020:00000080:1.0:1787764870.193946:0:11274:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcd3a6d6f0 20000000:00000080:1.0:1787764870.193962:0:11274:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dfcd8a51000 uarg=0000000000000000 20000000:01000000:1.0:1787764870.193991:0:11274:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787764870.193996:0:11274:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787764870.194000:0:11274:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787764870.194916:0:11275:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1787764870.195032:0:11274:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787764870.197464:0:11274:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787764870.197501:0:11274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dfce1d35400/0xdf82b4f42fb37c81 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764870.197521:0:11274:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dfce1d35a00/0xdf82b4f42fb37c57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37c50 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764870.197528:0:11274:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dfcc92b3800/0xdf82b4f42fb37c65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37c5e expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764870.197535:0:11274:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dfce1d34e00/0xdf82b4f42fb37c73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37c6c expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764870.197545:0:11274:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dfcc92b3000/0xdf82b4f42fb37c7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b14 expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764870.197552:0:11274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dfce1d35400/0xdf82b4f42fb37c81 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764870.197593:0:11274:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dfcc92b3000/0xdf82b4f42fb37c7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b14 expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764870.197607:0:11274:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dfcc92b3000/0xdf82b4f42fb37c7a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b14 expref: 9 pid: 5804 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764870.197642:0:11274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc6b9cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11274:1874607176988288:192.168.202.53@tcp:104: 00010000:00010000:1.0:1787764870.197787:0:11274:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dfce1d34e00/0xdf82b4f42fb37c73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf82b4f42fb37c6c expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764870.197797:0:11274:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dfce1d34e00/0xdf82b4f42fb37c73 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf82b4f42fb37c6c expref: 18 pid: 5802 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764870.197817:0:11274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc6b9da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11274:1874607176988416:0@lo:104: 00000100:00100000:1.0:1787764870.197859:0:11274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787764870.197942:0:11274:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dfcc92b3800/0xdf82b4f42fb37c65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf82b4f42fb37c5e expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764870.197951:0:11274:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dfcc92b3800/0xdf82b4f42fb37c65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf82b4f42fb37c5e expref: 18 pid: 5802 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764870.197959:0:11274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcf522f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11274:1874607176988544:0@lo:104: 00000100:00100000:1.0:1787764870.197993:0:11274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787764870.198595:0:11274:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dfce1d35a00/0xdf82b4f42fb37c57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf82b4f42fb37c50 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764870.198601:0:11274:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dfce1d35a00/0xdf82b4f42fb37c57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf82b4f42fb37c50 expref: 18 pid: 5803 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764870.198608:0:11274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcfc203480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11274:1874607176988672:0@lo:104: 00000100:00100000:1.0:1787764870.198642:0:11274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764870.198895:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176988416 00000100:00100000:0.0:1787764870.198901:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176988416 00000100:00100000:0.0:1787764870.198940:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176988544 00000100:00100000:0.0:1787764870.198942:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176988544 00000100:00100000:0.0:1787764870.198958:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787764870.198963:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc6b9f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+4:11274:x1874607176988416:12345-0@lo:104: 00010000:00010000:0.0:1787764870.198972:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff9dfcc0031600/0xdf82b4f42fb37c6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37c73 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764870.199008:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787764870.199011:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc6b9f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+4:11274:x1874607176988416:12345-0@lo:104: Request processed in 49us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764870.199016:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787764870.199033:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787764870.199036:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfc201a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+3:11274:x1874607176988544:12345-0@lo:104: 00010000:00010000:0.0:1787764870.199041:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67600/0xdf82b4f42fb37c5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37c65 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764870.199063:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787764870.199066:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfc201a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+3:11274:x1874607176988544:12345-0@lo:104: Request processed in 30us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764870.199069:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1787764870.199095:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787764870.199100:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff9dfcc0031600/0xdf82b4f42fb37c6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37c73 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764870.199105:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcc0031600 already unused, calling callback (ffffffffc1cc6c20) 10000000:00010000:0.0:1787764870.199108:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff9dfcc0031600/0xdf82b4f42fb37c6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf82b4f42fb37c73 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764870.199113:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff9dfcc0031600/0xdf82b4f42fb37c6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf82b4f42fb37c73 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787764870.199117:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff9dfcc0031600/0xdf82b4f42fb37c6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf82b4f42fb37c73 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787764870.199120:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787764870.199152:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff9dfcc0031600/0xdf82b4f42fb37c6c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37c73 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764870.199156:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787764870.199170:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff9dfcc0031600/0xdf82b4f42fb37c6c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37c73 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764870.199182:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff9dfcc0031600/0xdf82b4f42fb37c6c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37c73 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764870.199190:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787764870.199191:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67600/0xdf82b4f42fb37c5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37c65 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764870.199195:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcdab67600 already unused, calling callback (ffffffffc1cc6c20) 10000000:00010000:0.0:1787764870.199197:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67600/0xdf82b4f42fb37c5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf82b4f42fb37c65 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764870.199201:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67600/0xdf82b4f42fb37c5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf82b4f42fb37c65 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787764870.199204:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67600/0xdf82b4f42fb37c5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf82b4f42fb37c65 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787764870.199207:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787764870.199215:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67600/0xdf82b4f42fb37c5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37c65 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764870.199218:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787764870.199226:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67600/0xdf82b4f42fb37c5e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37c65 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764870.199230:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67600/0xdf82b4f42fb37c5e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37c65 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764870.199235:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764870.199239:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764870.199241:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764870.199245:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764870.199253:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcfc217c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3287:1874607176988800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787764870.199273:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764870.199301:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176988800 00000100:00100000:0.0:1787764870.199304:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176988800 00010000:00010000:0.0:1787764870.199320:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dfce1d34e00/0xdf82b4f42fb37c73 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37c6c expref: 19 pid: 5802 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764870.199341:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787764870.199348:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfc2152c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3287:x1874607176988800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787764870.199357:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787764870.199361:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dfce1d34e00/0xdf82b4f42fb37c73 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37c6c expref: 19 pid: 5802 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764870.199367:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dfce1d34e00/0xdf82b4f42fb37c73 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf82b4f42fb37c6c expref: 19 pid: 5802 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764870.199378:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787764870.199396:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfc2152c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3287:x1874607176988800:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764870.199401:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787764870.199423:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcfc217c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3287:1874607176988800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787764870.199782:0:11274:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc6b36b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787764870.199796:0:11274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc6b9cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11274:1874607176988288:192.168.202.53@tcp:104: 00010000:00010000:1.0:1787764870.199805:0:11274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dfce1d34e00/0xdf82b4f42fb37c73 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf82b4f42fb37c6c expref: 18 pid: 5802 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764870.199815:0:11274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc6b9da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11274:1874607176988416:0@lo:104: 00000100:00100000:1.0:1787764870.199822:0:11274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcf522f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11274:1874607176988544:0@lo:104: 00000100:00100000:0.0:1787764870.199864:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176988672 00000100:00100000:0.0:1787764870.199868:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176988672 00000100:00100000:0.0:1787764870.199898:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787764870.199905:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfc2012c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+3:11274:x1874607176988672:12345-0@lo:104: 00010000:00010000:0.0:1787764870.199913:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67200/0xdf82b4f42fb37c50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37c57 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764870.200003:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787764870.200008:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfc2012c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+3:11274:x1874607176988672:12345-0@lo:104: Request processed in 105us (1366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764870.200014:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1787764870.200029:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787764870.200034:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67200/0xdf82b4f42fb37c50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf82b4f42fb37c57 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764870.200041:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcdab67200 already unused, calling callback (ffffffffc1cc6c20) 10000000:00010000:0.0:1787764870.200044:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67200/0xdf82b4f42fb37c50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf82b4f42fb37c57 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764870.200051:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67200/0xdf82b4f42fb37c50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf82b4f42fb37c57 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787764870.200058:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67200/0xdf82b4f42fb37c50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf82b4f42fb37c57 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787764870.200063:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787764870.200107:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67200/0xdf82b4f42fb37c50 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37c57 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764870.200113:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787764870.200120:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67200/0xdf82b4f42fb37c50 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37c57 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764870.200127:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff9dfcdab67200/0xdf82b4f42fb37c50 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf82b4f42fb37c57 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764870.200210:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764870.200212:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764870.200214:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764870.200323:0:11274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcfc203480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11274:1874607176988672:0@lo:104: 00010000:00010000:2.0:1787764870.200358:0:11274:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dfce1d35400/0xdf82b4f42fb37c81 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764870.200753:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcfc217480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3288:1874607176988928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787764870.200789:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764870.200857:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787764870.200864:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcfc217c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3288:1874607176989056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787764870.200885:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764870.201067:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176988928 00000100:00100000:1.0:1787764870.201073:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176988928 00010000:00010000:1.0:1787764870.201153:0:7603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dfcc92b3800/0xdf82b4f42fb37c65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37c5e expref: 18 pid: 5802 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764870.201174:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176989056 00000100:00100000:1.0:1787764870.201177:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176989056 00010000:00010000:1.0:1787764870.201188:0:7603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dfce1d35a00/0xdf82b4f42fb37c57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37c50 expref: 19 pid: 5803 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764870.201207:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787764870.201214:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc81e8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3288:x1874607176988928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787764870.201223:0:7603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787764870.201227:0:7603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dfcc92b3800/0xdf82b4f42fb37c65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37c5e expref: 19 pid: 5802 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764870.201235:0:7603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dfcc92b3800/0xdf82b4f42fb37c65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf82b4f42fb37c5e expref: 19 pid: 5802 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764870.201246:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dfcc92b3800/0xdf82b4f42fb37c65 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf82b4f42fb37c5e expref: 19 pid: 5802 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764870.201257:0:7603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787764870.201288:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc81e8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:3288:x1874607176988928:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764870.201294:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787764870.201330:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787764870.201337:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc77de580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+17:3288:x1874607176989056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787764870.201343:0:7603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787764870.201347:0:7603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dfce1d35a00/0xdf82b4f42fb37c57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf82b4f42fb37c50 expref: 17 pid: 5803 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764870.201364:0:7603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dfce1d35a00/0xdf82b4f42fb37c57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf82b4f42fb37c50 expref: 17 pid: 5803 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764870.201374:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dfce1d35a00/0xdf82b4f42fb37c57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf82b4f42fb37c50 expref: 17 pid: 5803 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764870.201383:0:7603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787764870.201405:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc77de580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+16:3288:x1874607176989056:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764870.201412:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787764870.201436:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcfc217c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3288:1874607176989056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787764870.201441:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcfc217480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3288:1874607176988928:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787764870.202068:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1787764870.202120:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164369792 00000100:00100000:0.0:1787764870.202124:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164369792 00010000:00010000:0.0:1787764870.202143:0:7603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dfcc92b3000/0xdf82b4f42fb37c7a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b14 expref: 10 pid: 5804 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764870.202170:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 27 00000100:00100000:0.0:1787764870.202178:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfc201e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2345:x1874607164369792:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787764870.202188:0:7603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787764870.202192:0:7603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dfcc92b3000/0xdf82b4f42fb37c7a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b14 expref: 10 pid: 5804 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764870.202201:0:7603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dfcc92b3000/0xdf82b4f42fb37c7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b14 expref: 10 pid: 5804 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764870.202212:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dfcc92b3000/0xdf82b4f42fb37c7a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b14 expref: 10 pid: 5804 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764870.202223:0:7603:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dfce1d35400/0xdf82b4f42fb37c81 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764870.202232:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfce1d35400/0xdf82b4f42fb37c81 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764870.202244:0:7603:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dfce1d35400/0xdf82b4f42fb37c81 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764870.202261:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dfce1d35400/0xdf82b4f42fb37c81 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764870.202268:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dfce1d35400/0xdf82b4f42fb37c81 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764870.202275:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dfce1d35400/0xdf82b4f42fb37c81 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764870.202281:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfce1d35400 already unused, calling callback (ffffffffc16cb530) 00010000:00010000:0.0:1787764870.202286:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dfce1d35400/0xdf82b4f42fb37c81 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764870.202305:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dfce1d35400/0xdf82b4f42fb37c81 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764870.202320:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dfce1d35400/0xdf82b4f42fb37c81 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764870.202331:0:7603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787764870.202348:0:11274:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dfce1d35400/0xdf82b4f42fb37c81 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764870.202355:0:11274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dfce1d35400/0xdf82b4f42fb37c81 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764870.202361:0:11274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dfce1d35400/0xdf82b4f42fb37c81 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764870.202372:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfc201e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e307722-e9dd-4631-8a6a-b36b6b831f0c+9:2345:x1874607164369792:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 195us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764870.202379:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 27 00010000:00010000:0.0:1787764870.615560:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764871.384169:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787764871.384192:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcfc216940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176989184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787764871.384260:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764871.384295:0:9780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176989184 00000100:00100000:3.0:1787764871.384304:0:9780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176989184 00000100:00080000:0.0:1787764871.384337:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787764871.384369:0:9780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787764871.384380:0:9780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfc214780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176989184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787764871.384411:0:9780:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787764871.384523:0:9780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfc214780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176989184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 145us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764871.384533:0:9780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1787764871.384539:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcfc216940 x1874607176989184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764887 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764871.384566:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcfc216940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176989184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787764871.384591:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc77dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3287:1874607176989312:0@lo:400:kworker.0 00000100:00100000:0.0:1787764871.384649:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764871.384695:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc77dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1874607176989824:0@lo:400:kworker.0 00000100:00100000:3.0:1787764871.384701:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc77dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1874607176989440:0@lo:400:kworker.0 00000100:00100000:0.0:1787764871.384731:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764871.384746:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc77dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1874607176989568:0@lo:400:kworker.0 00000100:00100000:0.0:1787764871.384768:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787764871.384778:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcc77df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176989696:0@lo:400:kworker.0 00000100:00100000:3.0:1787764871.384779:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764871.384793:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176989312 00000100:00100000:2.0:1787764871.384798:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176989312 00000100:00100000:0.0:1787764871.384820:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764871.384833:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176989824 00000100:00100000:3.0:1787764871.384839:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176989824 00000100:00100000:2.0:1787764871.384843:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787764871.384855:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc3629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+16:3287:x1874607176989312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764871.384890:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176989568 00000100:00100000:3.0:1787764871.384894:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176989568 00000100:00100000:0.0:1787764871.384902:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787764871.384909:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc3629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+16:3287:x1874607176989312:12345-0@lo:400:kworker.0 Request processed in 56us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764871.384916:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfc216940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1874607176989824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764871.384923:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1787764871.384929:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787764871.384939:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc77dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1874607176989568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764871.384960:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176989696 00000100:00100000:2.0:1787764871.384964:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176989696 00000100:00100000:0.0:1787764871.384969:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfc216940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1874607176989824:12345-0@lo:400:kworker.0 Request processed in 59us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764871.384977:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787764871.384991:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc77dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1874607176989568:12345-0@lo:400:kworker.0 Request processed in 52us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764871.385001:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787764871.385002:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787764871.385013:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfc216d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176989696:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787764871.385047:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787764871.385053:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787764871.385055:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfc216d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176989696:12345-0@lo:400:kworker.0 Request processed in 45us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764871.385064:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1787764871.385262:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcc77df480 x1874607176989696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764871.385274:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc77df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176989696:0@lo:400:kworker.0 00000100:00100000:3.0:1787764871.385328:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764871.385376:0:9173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176989440 00000100:00100000:3.0:1787764871.385380:0:9173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176989440 00000100:00100000:3.0:1787764871.385429:0:9173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787764871.385439:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc77dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1874607176989824:0@lo:400:kworker.0 00000100:00100000:3.0:1787764871.385441:0:9173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc77de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1874607176989440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764871.385456:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc77dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3287:1874607176989312:0@lo:400:kworker.0 00000100:00100000:3.0:1787764871.385488:0:9173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc77de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1874607176989440:12345-0@lo:400:kworker.0 Request processed in 52us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764871.385494:0:9173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787764871.385524:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc77dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1874607176989568:0@lo:400:kworker.0 00000100:00100000:0.0:1787764871.385661:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcc77dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1874607176989440:0@lo:400:kworker.0 10000000:01000000:0.0:1787764871.511180:0:5806:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787764871.511187:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dfcffb13800 from 7 10000000:01000000:0.0:1787764871.511193:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787764871.511237:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcc0031600/0xdf82b4f42fb37c88 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764871.511247:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff9dfcc0031600/0xdf82b4f42fb37c88 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764871.511256:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff9dfcc0031600/0xdf82b4f42fb37c88 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764871.511285:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcfc214f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176989952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787764871.511340:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764871.511384:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc6ae4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787764871.511396:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176989952 00000100:00100000:3.0:1787764871.511405:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176989952 00000100:00100000:3.0:1787764871.511449:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1787764871.511458:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc3629c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+16:5806:x1874607176989952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787764871.511471:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787764871.511484:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dfcdab66400/0xdf82b4f42fb37c8f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb37c88 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764871.511507:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfcdab66400/0xdf82b4f42fb37c8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb37c88 expref: 17 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764871.511519:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dfcdab66400/0xdf82b4f42fb37c8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37c88 expref: 17 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764871.511529:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcdab66400, rc 0) 00000100:00100000:3.0:1787764871.511574:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc3629c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+17:5806:x1874607176989952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764871.511583:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1787764871.511594:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcfc214f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176989952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787764871.511627:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff9dfcc0031600/0xdf82b4f42fb37c88 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37c8f expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764871.511638:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff9dfcc0031600/0xdf82b4f42fb37c88 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf82b4f42fb37c8f expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764871.511693:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcfc214f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176990080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787764871.511725:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764871.511843:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcc6ae4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787764871.513671:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176990080 00000100:00100000:3.0:1787764871.513680:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176990080 00000100:00100000:3.0:1787764871.513720:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787764871.513728:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+17:5806:x1874607176990080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787764871.513989:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+17:5806:x1874607176990080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 262us (2263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764871.513999:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787764871.514024:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcfc214f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176990080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787764871.514107:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcfc202940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176990208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787764871.514156:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764871.514194:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcfbd8a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787764871.514208:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176990208 00000100:00100000:3.0:1787764871.514213:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176990208 00000100:00100000:3.0:1787764871.514239:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1787764871.514246:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+17:5806:x1874607176990208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787764871.514384:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+17:5806:x1874607176990208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764871.514390:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1787764871.514409:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcfc202940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176990208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787764871.515192:0:11398:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787764871.515253:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787764871.515271:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787764871.515279:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfcc0031600/0xdf82b4f42fb37c88 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37c8f expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764871.515294:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff9dfcc0031600/0xdf82b4f42fb37c88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37c8f expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787764871.515317:0:5806:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787764871.515319:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dfcf55aa800 from 7 10000000:01000000:1.0:1787764871.515322:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787764871.515344:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfce1d35400/0xdf82b4f42fb37c96 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764871.515350:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff9dfce1d35400/0xdf82b4f42fb37c96 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764871.515356:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff9dfce1d35400/0xdf82b4f42fb37c96 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764871.515367:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcfc202940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176990336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787764871.515392:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764871.515413:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcfbd8af00 going to sleep for 11 seconds 00000100:00100000:3.0:1787764871.516483:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176990336 00000100:00100000:3.0:1787764871.516489:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176990336 00000100:00100000:3.0:1787764871.516523:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787764871.516531:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+17:5806:x1874607176990336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787764871.516542:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787764871.516554:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dfcdab66800/0xdf82b4f42fb37c9d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb37c96 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764871.516575:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfcdab66800/0xdf82b4f42fb37c9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb37c96 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764871.516586:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dfcdab66800/0xdf82b4f42fb37c9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37c96 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764871.516604:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcdab66800, rc 0) 00000100:00100000:3.0:1787764871.516661:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:5806:x1874607176990336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (1267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764871.516668:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787764871.516694:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcfc202940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176990336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787764871.516710:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff9dfce1d35400/0xdf82b4f42fb37c96 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37c9d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764871.516720:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff9dfce1d35400/0xdf82b4f42fb37c96 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf82b4f42fb37c9d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764871.516763:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcfc202940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176990464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787764871.516783:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764871.516812:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcfbd8af00 going to sleep for 11 seconds 00000100:00100000:3.0:1787764871.516824:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176990464 00000100:00100000:3.0:1787764871.516828:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176990464 00000100:00100000:3.0:1787764871.516852:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787764871.516859:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:5806:x1874607176990464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787764871.517047:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:5806:x1874607176990464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 187us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764871.517054:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1787764871.517096:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcfc202940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176990464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787764871.517132:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcfc202940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176990592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787764871.517176:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764871.517208:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcfbd8af00 going to sleep for 11 seconds 00000100:00100000:3.0:1787764871.517255:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176990592 00000100:00100000:3.0:1787764871.517259:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176990592 00000100:00100000:3.0:1787764871.517331:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787764871.517340:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:5806:x1874607176990592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787764871.517509:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:5806:x1874607176990592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764871.517517:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1787764871.517528:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcfc202940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176990592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787764871.518158:0:11399:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787764871.518241:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787764871.518259:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787764871.518268:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfce1d35400/0xdf82b4f42fb37c96 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37c9d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764871.518278:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff9dfce1d35400/0xdf82b4f42fb37c96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37c9d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787764871.518295:0:5806:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787764871.518298:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dfce623b000 from 7 10000000:01000000:1.0:1787764871.518301:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787764871.518323:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfce1d35600/0xdf82b4f42fb37ca4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764871.518330:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff9dfce1d35600/0xdf82b4f42fb37ca4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764871.518337:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff9dfce1d35600/0xdf82b4f42fb37ca4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764871.518351:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcfc200780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176990720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787764871.518378:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764871.518401:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcfbd8a480 going to sleep for 11 seconds 00000100:00100000:2.0:1787764871.518411:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176990720 00000100:00100000:2.0:1787764871.518418:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176990720 00000100:00100000:2.0:1787764871.518458:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787764871.518466:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+18:5806:x1874607176990720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787764871.518476:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764871.518485:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dfcc92b3800/0xdf82b4f42fb37cab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf82b4f42fb37ca4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764871.518502:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfcc92b3800/0xdf82b4f42fb37cab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf82b4f42fb37ca4 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764871.518512:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dfcc92b3800/0xdf82b4f42fb37cab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf82b4f42fb37ca4 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764871.518520:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcc92b3800, rc 0) 00000100:00100000:2.0:1787764871.518558:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:5806:x1874607176990720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764871.518565:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1787764871.518594:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcfc200780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176990720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787764871.518607:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff9dfce1d35600/0xdf82b4f42fb37ca4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37cab expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764871.518695:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff9dfce1d35600/0xdf82b4f42fb37ca4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf82b4f42fb37cab expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764871.518734:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcfc200780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176990848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787764871.518760:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764871.518775:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcfbd8a480 going to sleep for 11 seconds 00000100:00100000:2.0:1787764871.518793:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176990848 00000100:00100000:2.0:1787764871.518798:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176990848 00000100:00100000:2.0:1787764871.518824:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1787764871.518833:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:5806:x1874607176990848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787764871.518990:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:5806:x1874607176990848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 158us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764871.518996:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcfc200780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176990848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787764871.519010:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787764871.519026:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcfc200780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176990976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787764871.519062:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764871.519096:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176990976 00000100:00100000:2.0:1787764871.519101:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176990976 00000100:00100000:2.0:1787764871.519126:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787764871.519133:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:5806:x1874607176990976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787764871.519263:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:5806:x1874607176990976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764871.519270:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1787764871.519350:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcfbd8a480 going to sleep for 11 seconds 00000100:00100000:1.0:1787764871.519364:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcfc200780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:5806:1874607176990976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787764871.519862:0:11400:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787764871.519911:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787764871.519927:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787764871.519934:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff9dfce1d35600/0xdf82b4f42fb37ca4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37cab expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764871.519943:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff9dfce1d35600/0xdf82b4f42fb37ca4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf82b4f42fb37cab expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764871.639212:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787764871.959400:0:11471:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1787764872.005109:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1787764872.005363:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164369920 00000100:00100000:2.0:1787764872.005374:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164369920 00000100:00100000:2.0:1787764872.005427:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 225 00000100:00100000:2.0:1787764872.005437:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e307722-e9dd-4631-8a6a-b36b6b831f0c+9:5577:x1874607164369920:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787764872.005454:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764872.005471:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dfcc92b3000/0xdf82b4f42fb37cb2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2033f7a1f5725b1b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764872.005499:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dfcc92b3000/0xdf82b4f42fb37cb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b1b expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764872.005508:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dfcc92b3000/0xdf82b4f42fb37cb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b1b expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764872.005515:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcc92b3000, rc 0) 00000100:00100000:2.0:1787764872.005570:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:5577:x1874607164369920:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 Request processed in 133us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764872.005588:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 225 00000100:00100000:3.0:1787764872.008513:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1787764872.008561:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164370048 00000100:00100000:1.0:1787764872.008568:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164370048 00000100:00100000:1.0:1787764872.008620:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 226 00000100:00100000:1.0:1787764872.008630:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:5577:x1874607164370048:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787764872.008859:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:5577:x1874607164370048:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 Request processed in 229us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764872.008867:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 226 00000100:00100000:0.0:1787764872.011716:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764872.011762:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164370176 00000100:00100000:3.0:1787764872.011770:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164370176 00000100:00100000:3.0:1787764872.011816:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 227 00000100:00100000:3.0:1787764872.011827:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:5577:x1874607164370176:12345-192.168.202.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787764872.012045:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:5577:x1874607164370176:12345-192.168.202.53@tcp:503:ll_cfg_requeue.0 Request processed in 220us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764872.012052:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 227 00010000:00010000:0.0:1787764872.664239:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764873.687434:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764874.455296:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcfc200780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607176991104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787764874.455369:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764874.455489:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176991104 00000100:00100000:2.0:1787764874.455498:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176991104 00000100:00080000:3.0:1787764874.455536:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787764874.455566:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787764874.455577:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfc217840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607176991104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787764874.455695:0:6655:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787764874.455749:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfc217840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607176991104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 174us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764874.455757:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1787764874.455795:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcfc200780 x1874607176991104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764890 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764874.455813:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcfc200780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607176991104:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787764874.711454:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764875.275501:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1787764875.277053:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164370304 00000100:00100000:1.0:1787764875.277066:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164370304 00000100:00100000:1.0:1787764875.277206:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 228 00000100:00100000:1.0:1787764875.277228:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2346:x1874607164370304:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1787764875.277313:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2346:x1874607164370304:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 87us (1822us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764875.277321:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 228 00000100:00100000:1.0:1787764875.316203:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764875.316299:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164370432 00000100:00100000:3.0:1787764875.316310:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164370432 00000100:00100000:3.0:1787764875.316395:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 81 00000100:00100000:3.0:1787764875.316405:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfc202d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2345:x1874607164370432:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1787764875.316495:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfc202d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2345:x1874607164370432:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 92us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764875.316502:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 81 00000100:00080000:0.0:1787764875.317138:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787764875.735473:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764876.503260:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcfc203840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3289:1874607176991360:0@lo:400:kworker.0 00000100:00100000:0.0:1787764876.503295:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcfc200b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1874607176991488:0@lo:400:kworker.0 00000100:00100000:1.0:1787764876.503311:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcfc2021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1874607176991616:0@lo:400:kworker.0 00000100:00100000:0.0:1787764876.503347:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764876.503347:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764876.503368:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcfc214b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176991232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787764876.503409:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764876.503435:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcfc201680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176991744:0@lo:400:kworker.0 00000100:00100000:0.0:1787764876.503437:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcfc2030c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176992000:0@lo:400:kworker.0 00000100:00100000:1.0:1787764876.503437:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcfc200000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1874607176991872:0@lo:400:kworker.0 00000100:00100000:1.0:1787764876.503487:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764876.503488:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764876.503520:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764876.503548:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176991360 00000100:00100000:3.0:1787764876.503556:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176991360 00000100:00100000:2.0:1787764876.503601:0:9173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176991488 00000100:00100000:2.0:1787764876.503607:0:9173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176991488 00000100:00100000:0.0:1787764876.503611:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176991872 00000100:00100000:0.0:1787764876.503617:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176991872 00000100:00100000:3.0:1787764876.503631:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787764876.503644:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3289:x1874607176991360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764876.503645:0:9173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176991616 00000100:00100000:2.0:1787764876.503650:0:9173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176991616 00000100:00100000:0.0:1787764876.503665:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787764876.503677:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfc2161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1874607176991488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764876.503683:0:9173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787764876.503702:0:9173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfc2003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1874607176991872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764876.503708:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3289:x1874607176991360:12345-0@lo:400:kworker.0 Request processed in 65us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764876.503709:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787764876.503721:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1787764876.503724:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfc215e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1874607176991616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764876.503727:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfc2161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1874607176991488:12345-0@lo:400:kworker.0 Request processed in 52us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764876.503737:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787764876.503760:0:9173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfc2003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1874607176991872:12345-0@lo:400:kworker.0 Request processed in 68us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764876.503766:0:9780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176991232 00000100:00100000:2.0:1787764876.503770:0:9173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787764876.503773:0:9780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176991232 00000100:00100000:1.0:1787764876.503778:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfc215e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1874607176991616:12345-0@lo:400:kworker.0 Request processed in 59us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764876.503785:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787764876.503816:0:9780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787764876.503825:0:9780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfc202580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607176991232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787764876.503850:0:9780:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787764876.503862:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcfc2021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1874607176991616:0@lo:400:kworker.0 00000100:00100000:3.0:1787764876.503865:0:6794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176991744 00000100:00100000:3.0:1787764876.503871:0:6794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176991744 00000100:00100000:2.0:1787764876.503881:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764876.503901:0:9780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfc202580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607176991232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764876.503908:0:9780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787764876.503916:0:6794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176992000 00000100:00100000:3.0:1787764876.503922:0:6794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176992000 00000100:00080000:0.0:1787764876.503931:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787764876.503936:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787764876.503939:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787764876.503944:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcfc200b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1874607176991488:0@lo:400:kworker.0 00000100:00100000:3.0:1787764876.503959:0:6794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787764876.503970:0:6794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc77dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176991744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764876.503986:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787764876.503998:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc56c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176992000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764876.504018:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcfc203840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3289:1874607176991360:0@lo:400:kworker.0 00000100:00100000:3.0:1787764876.504035:0:6794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc77dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176991744:12345-0@lo:400:kworker.0 Request processed in 54us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764876.504046:0:6794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787764876.504050:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc56c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176992000:12345-0@lo:400:kworker.0 Request processed in 54us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764876.504060:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1787764876.504159:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcfc201680 x1874607176991744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787764876.504165:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcfc214b40 x1874607176991232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764892 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787764876.504176:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcfc2030c0 x1874607176992000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764876.504183:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcfc201680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176991744:0@lo:400:kworker.0 00000100:00100000:0.0:1787764876.504193:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcfc214b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176991232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787764876.504208:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcfc200000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1874607176991872:0@lo:400:kworker.0 00000100:00100000:1.0:1787764876.504233:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcfc2030c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176992000:0@lo:400:kworker.0 00010000:00010000:1.0:1787764876.761107:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764877.783610:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764878.809030:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787764878.878268:0:11570:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-compr: finish setup 13:21:16 (1787764876) === 00000100:00100000:2.0:1787764879.575782:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787764879.575820:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcfc2021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176992128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787764879.575891:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764879.576559:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176992128 00000100:00100000:3.0:1787764879.576568:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176992128 00000100:00100000:3.0:1787764879.576645:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787764879.576655:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc56c3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176992128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787764879.576692:0:6655:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787764879.576754:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc56c3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176992128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764879.576762:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1787764879.576833:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787764879.576864:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcfc2021c0 x1874607176992128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764895 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764879.576884:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcfc2021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176992128:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787764879.832685:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764880.388186:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1787764880.388241:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1787764880.388245:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164370560 00000100:00100000:1.0:1787764880.388255:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164370560 00000100:00100000:0.0:1787764880.388286:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164370688 00000100:00100000:0.0:1787764880.388291:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164370688 00000100:00100000:1.0:1787764880.388337:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 230 00000100:00080000:2.0:1787764880.388346:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787764880.388352:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2346:x1874607164370560:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1787764880.388360:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 85 00000100:00100000:0.0:1787764880.388372:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc56c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2346:x1874607164370688:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1787764880.388428:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc56c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2346:x1874607164370688:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 59us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764880.388435:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 85 00000100:00100000:1.0:1787764880.388604:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2346:x1874607164370560:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 257us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764880.388612:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 230 00010000:00010000:1.0:1787764880.858321:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764881.623244:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcfc214f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176992256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787764881.623321:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764881.623399:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176992256 00000100:00100000:2.0:1787764881.623406:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176992256 00000100:00100000:2.0:1787764881.623469:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787764881.623479:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc56c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176992256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787764881.623513:0:6656:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787764881.623576:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc56c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176992256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764881.623584:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1787764881.623866:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcfc214f00 x1874607176992256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764897 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764881.623885:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcfc214f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176992256:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787764881.624631:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787764881.625043:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcfc217480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3286:1874607176992384:0@lo:400:kworker.0 00000100:00100000:2.0:1787764881.625110:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764881.625130:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcfc2143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176992768:0@lo:400:kworker.0 00000100:00100000:2.0:1787764881.625154:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcfc214f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1874607176992896:0@lo:400:kworker.0 00000100:00100000:0.0:1787764881.625166:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764881.625190:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787764881.625198:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcfc2152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1874607176992640:0@lo:400:kworker.0 00000100:00100000:2.0:1787764881.625216:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764881.625235:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176992768 00000100:00100000:0.0:1787764881.625240:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176992768 00000100:00100000:2.0:1787764881.625250:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787764881.625258:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcfc217c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607176992512:0@lo:400:kworker.0 00000100:00100000:0.0:1787764881.625285:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787764881.625288:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764881.625298:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfc214b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176992768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764881.625322:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176992384 00000100:00100000:2.0:1787764881.625327:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176992384 00000100:00100000:0.0:1787764881.625344:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfc214b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176992768:12345-0@lo:400:kworker.0 Request processed in 49us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764881.625353:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787764881.625358:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787764881.625367:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3286:x1874607176992384:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787764881.625376:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787764881.625389:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764881.625421:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3286:x1874607176992384:12345-0@lo:400:kworker.0 Request processed in 54us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764881.625428:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787764881.625458:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176992896 00000100:00100000:2.0:1787764881.625462:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176992896 00000100:00100000:3.0:1787764881.625471:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176992512 00000100:00100000:3.0:1787764881.625477:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176992512 00000100:00100000:2.0:1787764881.625497:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176992640 00000100:00100000:2.0:1787764881.625501:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176992640 00000100:00100000:3.0:1787764881.625512:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787764881.625531:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc56c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1874607176992896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764881.625586:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc56c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1874607176992896:12345-0@lo:400:kworker.0 Request processed in 65us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764881.625594:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787764881.625609:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787764881.625617:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc56c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607176992512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764881.625640:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787764881.625649:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc56c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607176992512:12345-0@lo:400:kworker.0 Request processed in 33us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764881.625654:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffb53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1874607176992640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764881.625661:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787764881.625685:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcfc217c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607176992512:0@lo:400:kworker.0 00000100:00100000:2.0:1787764881.625723:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcfc214f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1874607176992896:0@lo:400:kworker.0 00000100:00100000:2.0:1787764881.625740:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcfc217480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3286:1874607176992384:0@lo:400:kworker.0 00000100:00080000:1.0:1787764881.625745:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787764881.625781:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffb53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1874607176992640:12345-0@lo:400:kworker.0 Request processed in 131us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764881.625788:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787764881.626078:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcfc2152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1874607176992640:0@lo:400:kworker.0 00010000:00080000:0.0:1787764881.626111:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcfc2143c0 x1874607176992768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764881.626121:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcfc2143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176992768:0@lo:400:kworker.0 00010000:00010000:1.0:1787764881.879512:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764882.903285:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764883.927214:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764884.695326:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcfc203c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176993024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787764884.695393:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764884.695525:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176993024 00000100:00100000:3.0:1787764884.695533:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176993024 00000100:00080000:1.0:1787764884.695585:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787764884.695597:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787764884.695608:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc56c2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176993024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787764884.695843:0:6655:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787764884.695896:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc56c2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176993024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 290us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764884.695905:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1787764884.695940:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcfc203c00 x1874607176993024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764884.695959:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcfc203c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176993024:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787764884.952944:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764885.517170:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1787764885.517226:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764885.517301:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164370816 00000100:00100000:3.0:1787764885.517311:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164370816 00000100:00100000:3.0:1787764885.517373:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 232 00000100:00100000:3.0:1787764885.517384:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2345:x1874607164370816:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1787764885.517405:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164370944 00000100:00100000:1.0:1787764885.517410:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164370944 00000100:00100000:3.0:1787764885.517467:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e307722-e9dd-4631-8a6a-b36b6b831f0c+10:2345:x1874607164370816:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 84us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764885.517475:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 89 00000100:00100000:1.0:1787764885.517523:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfc2143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2345:x1874607164370944:12345-192.168.202.53@tcp:400:kworker.0 00000100:00080000:0.0:1787764885.517530:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787764885.517567:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfc2143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2345:x1874607164370944:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 83us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764885.517575:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 89 00000100:00100000:3.0:1787764885.517971:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 232 00010000:00010000:1.0:1787764885.975369:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764886.537751:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1787764886.537806:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1787764886.537824:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164371200 00000100:00100000:0.0:1787764886.537837:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164371200 00000100:00100000:3.0:1787764886.537846:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164371072 00000100:00100000:3.0:1787764886.537853:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164371072 00000100:00100000:3.0:1787764886.537909:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 10 00000100:00100000:0.0:1787764886.537910:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 0 00000100:00100000:2.0:1787764886.537920:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 2 min 2 max 256 00000100:00100000:0.0:1787764886.537925:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfc2152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c035addb-e6b1-4a9c-9554-21f3e0d84883+7:9890:x1874607164371200:12345-192.168.202.53@tcp:700:mkdir.0 00000100:00100000:2.0:1787764886.537931:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0002' 00000100:00100000:3.0:1787764886.537936:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfc217480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+7:2346:x1874607164371072:12345-192.168.202.53@tcp:41:mkdir.0 00000004:00000024:3.0:1787764886.537971:0:5810:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787764886.538025:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfc2152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c035addb-e6b1-4a9c-9554-21f3e0d84883+7:9890:x1874607164371200:12345-192.168.202.53@tcp:700:mkdir.0 Request processed in 93us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764886.538033:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfc217480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+7:2346:x1874607164371072:12345-192.168.202.53@tcp:41:mkdir.0 Request processed in 100us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764886.538040:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 0 00000100:00100000:3.0:1787764886.538047:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 10 00000100:00100000:2.0:1787764886.539417:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1787764886.539627:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164371456 00000100:00100000:1.0:1787764886.539633:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164371456 00000100:00100000:1.0:1787764886.539715:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 11 00000100:00100000:1.0:1787764886.539724:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfc214f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:9890:x1874607164371456:12345-192.168.202.53@tcp:36:mkdir.0 00010000:00010000:1.0:1787764886.539782:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787764886.539830:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab66c00/0xdf82b4f42fb37b5b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725aff expref: 6 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.539847:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dfce0e3cb00) 00010000:00010000:1.0:1787764886.539870:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787764886.540675:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34000/0xdf82b4f42fb37cb9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.540687:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34000/0xdf82b4f42fb37cb9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.540695:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34000/0xdf82b4f42fb37cb9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.540717:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34e00/0xdf82b4f42fb37cc0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.540722:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34e00/0xdf82b4f42fb37cc0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.540733:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34e00/0xdf82b4f42fb37cc0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787764886.541786:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787764886.541798:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34000/0xdf82b4f42fb37cb9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.541807:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34000/0xdf82b4f42fb37cb9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.541814:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34000/0xdf82b4f42fb37cb9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.541820:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfce1d34000 already unused, calling callback (ffffffffc20ea4f0) 00010000:00010000:1.0:1787764886.541824:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34000/0xdf82b4f42fb37cb9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.541831:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34000/0xdf82b4f42fb37cb9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.541843:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dfced7f2700) 00010000:00010000:1.0:1787764886.541846:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787764886.541851:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34000/0xdf82b4f42fb37cb9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.541858:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34000/0xdf82b4f42fb37cb9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787764886.541872:0:5809:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ef21084 reply state 0000000050ad0b3f transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34e00/0xdf82b4f42fb37cc0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764886.541885:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787764886.541974:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfc214f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c035addb-e6b1-4a9c-9554-21f3e0d84883+7:9890:x1874607164371456:12345-192.168.202.53@tcp:36:mkdir.0 Request processed in 2248us (2555us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787764886.541983:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 11 00010000:00010000:3.0:1787764886.543438:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34e00/0xdf82b4f42fb37cc0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.543453:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34e00/0xdf82b4f42fb37cc0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.543460:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34e00/0xdf82b4f42fb37cc0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.543467:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfce1d34e00 already unused, calling callback (ffffffffc20ea4f0) 00010000:00010000:3.0:1787764886.543471:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34e00/0xdf82b4f42fb37cc0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.543489:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34e00/0xdf82b4f42fb37cc0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.543508:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9dfced7f2e00) 00010000:00010000:3.0:1787764886.543512:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787764886.543516:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34e00/0xdf82b4f42fb37cc0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.543522:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34e00/0xdf82b4f42fb37cc0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764886.550461:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1787764886.550612:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164371584 00000100:00100000:1.0:1787764886.550622:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164371584 00000100:00100000:1.0:1787764886.550718:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 12 00000100:00100000:1.0:1787764886.550730:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfc217c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:9891:x1874607164371584:12345-192.168.202.53@tcp:101:chmod.0 00010000:00010000:1.0:1787764886.550751:0:6455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787764886.550772:0:6455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34000/0xdf82b4f42fb37cc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2033f7a1f5725b22 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.550848:0:6455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35a00/0xdf82b4f42fb37cce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.550863:0:6455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35a00/0xdf82b4f42fb37cce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.550875:0:6455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35a00/0xdf82b4f42fb37cce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787764886.550934:0:6455:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787764886.550938:0:6455:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787764886.550988:0:6455:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35a00/0xdf82b4f42fb37cce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.551014:0:6455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34000/0xdf82b4f42fb37cc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b22 expref: 8 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.551050:0:6455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35a00/0xdf82b4f42fb37cce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b22 expref: 7 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.551057:0:6455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dfced7f2700) 00010000:00010000:1.0:1787764886.551060:0:6455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787764886.551063:0:6455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfce1d35a00, rc 0) 00000100:00100000:1.0:1787764886.551148:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfc217c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c035addb-e6b1-4a9c-9554-21f3e0d84883+7:9891:x1874607164371584:12345-192.168.202.53@tcp:101:chmod.0 Request processed in 420us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764886.551155:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 12 00000100:00100000:2.0:1787764886.556237:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764886.556688:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164371840 00000100:00100000:3.0:1787764886.556707:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164371840 00000100:00100000:3.0:1787764886.556774:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 13 00000100:00100000:3.0:1787764886.556785:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcf522f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+7:9891:x1874607164371840:12345-192.168.202.53@tcp:36:chmod.0 00010000:00010000:3.0:1787764886.556838:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787764886.556863:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35a00/0xdf82b4f42fb37cce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b22 expref: 7 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.556882:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dfced7f2700) 00010000:00010000:3.0:1787764886.556891:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787764886.556914:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67400/0xdf82b4f42fb37cd5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.556924:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67400/0xdf82b4f42fb37cd5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.556931:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67400/0xdf82b4f42fb37cd5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787764886.557196:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009ac417f0 reply state 00000000df2aadf4 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67400/0xdf82b4f42fb37cd5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764886.557203:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787764886.557212:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787764886.557299:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcf522f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+8:9891:x1874607164371840:12345-192.168.202.53@tcp:36:chmod.0 Request processed in 515us (1070us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787764886.557307:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 13 00010000:00010000:0.0:1787764886.560584:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67400/0xdf82b4f42fb37cd5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764886.560601:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67400/0xdf82b4f42fb37cd5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764886.560620:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67400/0xdf82b4f42fb37cd5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764886.560626:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcdab67400 already unused, calling callback (ffffffffc20ea4f0) 00010000:00010000:0.0:1787764886.560631:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67400/0xdf82b4f42fb37cd5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764886.560639:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67400/0xdf82b4f42fb37cd5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764886.560659:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dfce0e3c500) 00010000:00010000:0.0:1787764886.560662:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787764886.560667:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67400/0xdf82b4f42fb37cd5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764886.560834:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67400/0xdf82b4f42fb37cd5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764886.588861:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1787764886.588935:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164371968 00000100:00100000:1.0:1787764886.588945:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164371968 00000100:00100000:1.0:1787764886.589048:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 14 00000100:00100000:1.0:1787764886.589059:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc6b9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c035addb-e6b1-4a9c-9554-21f3e0d84883+7:9892:x1874607164371968:12345-192.168.202.53@tcp:101:chown.0 00010000:00010000:1.0:1787764886.589116:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787764886.589137:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34000/0xdf82b4f42fb37cdc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2033f7a1f5725b29 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764886.589269:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030200/0xdf82b4f42fb37ce3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764886.589285:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030200/0xdf82b4f42fb37ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764886.589299:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030200/0xdf82b4f42fb37ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787764886.589372:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787764886.589376:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787764886.589453:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030200/0xdf82b4f42fb37ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764886.589504:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34000/0xdf82b4f42fb37cdc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b29 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764886.589552:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030200/0xdf82b4f42fb37ce3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b29 expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764886.589561:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dfced7f2c00) 00010000:00010000:0.0:1787764886.589565:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787764886.589569:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcc0030200, rc 0) 00000100:00100000:0.0:1787764886.589705:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc6b9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c035addb-e6b1-4a9c-9554-21f3e0d84883+8:9892:x1874607164371968:12345-192.168.202.53@tcp:101:chown.0 Request processed in 647us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764886.589713:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 14 00000100:00100000:2.0:1787764886.593133:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1787764886.593189:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164372096 00000100:00100000:1.0:1787764886.593200:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164372096 00000100:00100000:1.0:1787764886.593265:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 15 00000100:00100000:1.0:1787764886.593307:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc6b9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c035addb-e6b1-4a9c-9554-21f3e0d84883+8:9892:x1874607164372096:12345-192.168.202.53@tcp:101:chown.0 00010000:00010000:1.0:1787764886.593342:0:6455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787764886.593375:0:6455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34800/0xdf82b4f42fb37cea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2033f7a1f5725b30 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.593492:0:6455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34600/0xdf82b4f42fb37cf1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.593520:0:6455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34600/0xdf82b4f42fb37cf1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.593533:0:6455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34600/0xdf82b4f42fb37cf1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.593551:0:6455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34c00/0xdf82b4f42fb37cf8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.593559:0:6455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34c00/0xdf82b4f42fb37cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.593566:0:6455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34c00/0xdf82b4f42fb37cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.593709:0:6455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35200/0xdf82b4f42fb37cff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.593719:0:6455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35200/0xdf82b4f42fb37cff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.593727:0:6455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35200/0xdf82b4f42fb37cff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787764886.593794:0:6455:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787764886.593824:0:6455:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787764886.593873:0:6455:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35200/0xdf82b4f42fb37cff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.593922:0:6455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34600/0xdf82b4f42fb37cf1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.593928:0:6455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34600/0xdf82b4f42fb37cf1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.593955:0:6455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34600/0xdf82b4f42fb37cf1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.593962:0:6455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfce1d34600 already unused, calling callback (ffffffffc20ea4f0) 00010000:00010000:1.0:1787764886.593968:0:6455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34600/0xdf82b4f42fb37cf1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.593977:0:6455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34600/0xdf82b4f42fb37cf1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.593989:0:6455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dfced7f2c00) 00010000:00010000:1.0:1787764886.593992:0:6455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787764886.594023:0:6455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34600/0xdf82b4f42fb37cf1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.594031:0:6455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34600/0xdf82b4f42fb37cf1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.594044:0:6455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34c00/0xdf82b4f42fb37cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.594051:0:6455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34c00/0xdf82b4f42fb37cf8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.594057:0:6455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34c00/0xdf82b4f42fb37cf8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.594069:0:6455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfce1d34c00 already unused, calling callback (ffffffffc20ea4f0) 00010000:00010000:1.0:1787764886.594072:0:6455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34c00/0xdf82b4f42fb37cf8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.594197:0:6455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34c00/0xdf82b4f42fb37cf8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.594208:0:6455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9dfced7f2b00) 00010000:00010000:1.0:1787764886.594210:0:6455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787764886.594214:0:6455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34c00/0xdf82b4f42fb37cf8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.594238:0:6455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34c00/0xdf82b4f42fb37cf8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.594583:0:6455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34800/0xdf82b4f42fb37cea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b30 expref: 10 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.594601:0:6455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35200/0xdf82b4f42fb37cff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b30 expref: 9 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.594608:0:6455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9dfced7f2a00) 00010000:00010000:1.0:1787764886.594610:0:6455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787764886.594613:0:6455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfce1d35200, rc 0) 00000100:00100000:1.0:1787764886.594684:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc6b9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c035addb-e6b1-4a9c-9554-21f3e0d84883+9:9892:x1874607164372096:12345-192.168.202.53@tcp:101:chown.0 Request processed in 1409us (1560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764886.594692:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 15 00000100:00100000:1.0:1787764886.601674:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1787764886.601867:0:9173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164372352 00000100:00100000:2.0:1787764886.601879:0:9173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164372352 00000100:00100000:2.0:1787764886.601946:0:9173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 16 00000100:00100000:2.0:1787764886.601958:0:9173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfc2021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c035addb-e6b1-4a9c-9554-21f3e0d84883+9:9892:x1874607164372352:12345-192.168.202.53@tcp:36:chown.0 00010000:00010000:2.0:1787764886.602024:0:9173:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787764886.602053:0:9173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35200/0xdf82b4f42fb37cff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b30 expref: 9 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764886.602073:0:9173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9dfced7f2a00) 00010000:00010000:2.0:1787764886.602204:0:9173:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787764886.602232:0:9173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3a00/0xdf82b4f42fb37d06 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764886.602246:0:9173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3a00/0xdf82b4f42fb37d06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764886.602257:0:9173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3a00/0xdf82b4f42fb37d06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9173 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787764886.687002:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:0.0:1787764886.687022:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1787764886.687160:0:9173:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c8dc99ab reply state 0000000033691d9b transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3a00/0xdf82b4f42fb37d06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9173 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764886.687176:0:9173:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787764886.687352:0:9173:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:3.0:1787764886.687450:0:9173:0:(ldlm_lib.c:3520:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1787764886.687469:0:9173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfc2021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c035addb-e6b1-4a9c-9554-21f3e0d84883+7:9892:x1874607164372352:12345-192.168.202.53@tcp:36:chown.0 Request processed in 85509us (85801us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787764886.687493:0:9173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 16 00010000:00010000:3.0:1787764886.687531:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3a00/0xdf82b4f42fb37d06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.687540:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3a00/0xdf82b4f42fb37d06 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.687548:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3a00/0xdf82b4f42fb37d06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.687554:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcc92b3a00 already unused, calling callback (ffffffffc20ea4f0) 00010000:00010000:3.0:1787764886.687558:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3a00/0xdf82b4f42fb37d06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.687566:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3a00/0xdf82b4f42fb37d06 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.687582:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9dfce034cf00) 00010000:00010000:3.0:1787764886.687585:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787764886.687590:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3a00/0xdf82b4f42fb37d06 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.687597:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3a00/0xdf82b4f42fb37d06 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9173 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764886.722605:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1787764886.722941:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164372480 00000100:00100000:0.0:1787764886.722967:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164372480 00000100:00100000:1.0:1787764886.723327:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00100000:1.0:1787764886.723338:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfc2030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:9893:x1874607164372480:12345-192.168.202.53@tcp:101:touch.500 00010000:00010000:1.0:1787764886.723362:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787764886.723384:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34800/0xdf82b4f42fb37d0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2033f7a1f5725b37 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787764886.725185:0:5809:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1751us 00010000:00010000:3.0:1787764886.733914:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67e00/0xdf82b4f42fb37d14 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.733936:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67e00/0xdf82b4f42fb37d14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.733953:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67e00/0xdf82b4f42fb37d14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.733966:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67000/0xdf82b4f42fb37d1b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.733971:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67000/0xdf82b4f42fb37d1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.733976:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67000/0xdf82b4f42fb37d1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.734399:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67400/0xdf82b4f42fb37d22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.734405:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67400/0xdf82b4f42fb37d22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.734410:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67400/0xdf82b4f42fb37d22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787764886.734459:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787764886.734462:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787764886.734548:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67400/0xdf82b4f42fb37d22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.734559:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67e00/0xdf82b4f42fb37d14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.734564:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67e00/0xdf82b4f42fb37d14 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.734575:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67e00/0xdf82b4f42fb37d14 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.734579:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcdab67e00 already unused, calling callback (ffffffffc20ea4f0) 00010000:00010000:3.0:1787764886.734582:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67e00/0xdf82b4f42fb37d14 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.734587:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67e00/0xdf82b4f42fb37d14 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.734596:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dfced7f2c00) 00010000:00010000:3.0:1787764886.734598:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787764886.734602:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67e00/0xdf82b4f42fb37d14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.734605:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67e00/0xdf82b4f42fb37d14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.734612:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67000/0xdf82b4f42fb37d1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.734616:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67000/0xdf82b4f42fb37d1b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.734620:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67000/0xdf82b4f42fb37d1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.734623:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcdab67000 already unused, calling callback (ffffffffc20ea4f0) 00010000:00010000:3.0:1787764886.734624:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67000/0xdf82b4f42fb37d1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.734633:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67000/0xdf82b4f42fb37d1b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.734638:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9dfce0e3c300) 00010000:00010000:3.0:1787764886.734639:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787764886.734641:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67000/0xdf82b4f42fb37d1b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.734644:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67000/0xdf82b4f42fb37d1b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.734674:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34800/0xdf82b4f42fb37d0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b37 expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.734684:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67400/0xdf82b4f42fb37d22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b37 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.734688:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9dfce0e3cf00) 00010000:00010000:3.0:1787764886.734690:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787764886.734691:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcdab67400, rc 0) 00000100:00100000:3.0:1787764886.734763:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfc2030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c035addb-e6b1-4a9c-9554-21f3e0d84883+7:9893:x1874607164372480:12345-192.168.202.53@tcp:101:touch.500 Request processed in 11426us (12166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764886.734773:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00100000:2.0:1787764886.741208:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1787764886.741513:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164372736 00000100:00100000:1.0:1787764886.741524:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164372736 00000100:00100000:1.0:1787764886.741592:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00100000:1.0:1787764886.741604:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc6b9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c035addb-e6b1-4a9c-9554-21f3e0d84883+7:9893:x1874607164372736:12345-192.168.202.53@tcp:101:touch.500 00010000:00010000:1.0:1787764886.741628:0:6455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787764886.741655:0:6455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34c00/0xdf82b4f42fb37d29 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2033f7a1f5725b3e expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.742012:0:6455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34600/0xdf82b4f42fb37d30 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.742028:0:6455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34600/0xdf82b4f42fb37d30 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.742039:0:6455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34600/0xdf82b4f42fb37d30 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.742213:0:6455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35a00/0xdf82b4f42fb37d37 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.742223:0:6455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35a00/0xdf82b4f42fb37d37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.742243:0:6455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35a00/0xdf82b4f42fb37d37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787764886.743044:0:6455:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1787764886.743455:0:6455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34e00/0xdf82b4f42fb37d3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.743466:0:6455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34e00/0xdf82b4f42fb37d3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.743486:0:6455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34e00/0xdf82b4f42fb37d3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.743518:0:6455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34600/0xdf82b4f42fb37d30 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.743525:0:6455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34600/0xdf82b4f42fb37d30 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.743532:0:6455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34600/0xdf82b4f42fb37d30 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.743539:0:6455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfce1d34600 already unused, calling callback (ffffffffc20ea4f0) 00010000:00010000:1.0:1787764886.743543:0:6455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34600/0xdf82b4f42fb37d30 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.743550:0:6455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34600/0xdf82b4f42fb37d30 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.743562:0:6455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9dfce0e3cf00) 00010000:00010000:1.0:1787764886.743565:0:6455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787764886.743578:0:6455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34600/0xdf82b4f42fb37d30 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.743585:0:6455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34600/0xdf82b4f42fb37d30 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787764886.743600:0:6455:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bbfe6297 reply state 000000000ccafa16 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35a00/0xdf82b4f42fb37d37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764886.743609:0:6455:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787764886.743642:0:6455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34c00/0xdf82b4f42fb37d29 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b3e expref: 10 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.743657:0:6455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34e00/0xdf82b4f42fb37d3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b3e expref: 9 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.743664:0:6455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9dfced7f2100) 00010000:00010000:1.0:1787764886.743667:0:6455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787764886.743670:0:6455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfce1d34e00, rc 0) 00000100:00100000:0.0:1787764886.743736:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcffb53840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1874607176993280:0@lo:400:kworker.0 00000100:00100000:1.0:1787764886.743745:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc6b9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c035addb-e6b1-4a9c-9554-21f3e0d84883+10:9893:x1874607164372736:12345-192.168.202.53@tcp:101:touch.500 Request processed in 2140us (2547us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787764886.743755:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00100000:0.0:1787764886.743801:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764886.743853:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcffc761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176993792:0@lo:400:kworker.0 00000100:00100000:0.0:1787764886.743872:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764886.743902:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787764886.743907:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcffb51e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3289:1874607176993152:0@lo:400:kworker.0 00000100:00100000:2.0:1787764886.743916:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcffb52d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176993536:0@lo:400:kworker.0 00000100:00100000:0.0:1787764886.743937:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764886.743953:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcffb50780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607176993664:0@lo:400:kworker.0 00000100:00100000:0.0:1787764886.743966:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764886.743981:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcffb50f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607176993408:0@lo:400:kworker.0 00000100:00100000:0.0:1787764886.743995:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764886.744012:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176993792 00000100:00100000:0.0:1787764886.744016:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176993792 00000100:00100000:0.0:1787764886.744061:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787764886.744068:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffc74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176993792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764886.744112:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffc74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176993792:12345-0@lo:400:kworker.0 Request processed in 45us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764886.744116:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787764886.744129:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176993152 00000100:00100000:0.0:1787764886.744131:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176993152 00000100:00100000:0.0:1787764886.744145:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1787764886.744149:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc4fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3289:x1874607176993152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764886.744165:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc4fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ce65d8b-33b1-4c9d-a39f-9953ad302d03+19:3289:x1874607176993152:12345-0@lo:400:kworker.0 Request processed in 16us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764886.744177:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00080000:0.0:1787764886.744199:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787764886.744236:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcffc743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176993920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787764886.744254:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764886.744262:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764886.744385:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176993536 00000100:00100000:0.0:1787764886.744389:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176993536 00000100:00100000:0.0:1787764886.744418:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787764886.744424:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc6b9cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176993536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764886.744457:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc6b9cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607176993536:12345-0@lo:400:kworker.0 Request processed in 33us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764886.744462:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787764886.744489:0:9780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176993920 00000100:00100000:0.0:1787764886.744492:0:9780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176993920 00000100:00100000:0.0:1787764886.744516:0:9780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787764886.744522:0:9780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffc77c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607176993920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787764886.744548:0:9780:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787764886.744582:0:9780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffc77c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607176993920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764886.744588:0:9780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1787764886.744617:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787764886.744626:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176993280 00000100:00100000:0.0:1787764886.744629:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176993280 00000100:00100000:0.0:1787764886.744649:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176993664 00000100:00100000:0.0:1787764886.744652:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176993664 00000100:00100000:0.0:1787764886.744680:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176993408 00000100:00100000:0.0:1787764886.744684:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176993408 00000100:00100000:0.0:1787764886.744700:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787764886.744704:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffc75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1874607176993280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764886.744732:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffc75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1874607176993280:12345-0@lo:400:kworker.0 Request processed in 28us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764886.744736:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787764886.744744:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787764886.744747:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffc770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607176993664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764886.744763:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffc770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607176993664:12345-0@lo:400:kworker.0 Request processed in 16us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764886.744767:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787764886.744772:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787764886.744775:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffc76580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607176993408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764886.744788:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffc76580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607176993408:12345-0@lo:400:kworker.0 Request processed in 13us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764886.744792:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:0.0:1787764886.744802:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787764886.744819:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcffc743c0 x1874607176993920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764902 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764886.744832:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcffc743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176993920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787764886.744839:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcffb50f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607176993408:0@lo:400:kworker.0 00010000:00080000:0.0:1787764886.744858:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcffb52d00 x1874607176993536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764886.744864:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcffb52d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607176993536:0@lo:400:kworker.0 00000100:00100000:0.0:1787764886.744874:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcffb51e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ce65d8b-33b1-4c9d-a39f-9953ad302d03:3289:1874607176993152:0@lo:400:kworker.0 00000100:00100000:0.0:1787764886.744879:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcffb50780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607176993664:0@lo:400:kworker.0 00000100:00100000:0.0:1787764886.744891:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcffb53840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1874607176993280:0@lo:400:kworker.0 00010000:00080000:0.0:1787764886.744896:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcffc761c0 x1874607176993792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764886.744901:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcffc761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176993792:0@lo:400:kworker.0 00010000:00010000:1.0:1787764886.745388:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35a00/0xdf82b4f42fb37d37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.745398:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35a00/0xdf82b4f42fb37d37 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.745404:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35a00/0xdf82b4f42fb37d37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.745420:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfce1d35a00 already unused, calling callback (ffffffffc20ea4f0) 00010000:00010000:1.0:1787764886.745424:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35a00/0xdf82b4f42fb37d37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.745432:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35a00/0xdf82b4f42fb37d37 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.745445:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x94fd8476 (ffff9dfced7f2b00) 00010000:00010000:1.0:1787764886.745448:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787764886.745452:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35a00/0xdf82b4f42fb37d37 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.745458:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35a00/0xdf82b4f42fb37d37 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764886.749758:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1787764886.750421:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164372992 00000100:00100000:0.0:1787764886.750432:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164372992 00000100:00100000:0.0:1787764886.750507:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 19 00000100:00100000:0.0:1787764886.750519:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc32fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+9:9893:x1874607164372992:12345-192.168.202.53@tcp:36:touch.500 00010000:00010000:0.0:1787764886.750588:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787764886.750620:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34e00/0xdf82b4f42fb37d3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b3e expref: 9 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764886.750639:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9dfced7f2100) 00010000:00010000:0.0:1787764886.750652:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787764886.750717:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030600/0xdf82b4f42fb37d4c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764886.750733:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030600/0xdf82b4f42fb37d4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764886.750758:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030600/0xdf82b4f42fb37d4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787764886.750890:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c7656a04 reply state 0000000095e7eab8 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030600/0xdf82b4f42fb37d4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764886.750900:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787764886.751022:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc32fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+10:9893:x1874607164372992:12345-192.168.202.53@tcp:36:touch.500 Request processed in 506us (1273us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787764886.751030:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 19 00010000:00010000:3.0:1787764886.754727:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030600/0xdf82b4f42fb37d4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.754744:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030600/0xdf82b4f42fb37d4c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.754772:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030600/0xdf82b4f42fb37d4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.754779:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcc0030600 already unused, calling callback (ffffffffc20ea4f0) 00010000:00010000:3.0:1787764886.754783:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030600/0xdf82b4f42fb37d4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.754799:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030600/0xdf82b4f42fb37d4c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.754815:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9dfcc30a9f00) 00010000:00010000:3.0:1787764886.754818:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787764886.754824:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030600/0xdf82b4f42fb37d4c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.754835:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030600/0xdf82b4f42fb37d4c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764886.759970:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1787764886.760043:0:9173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164373120 00000100:00100000:0.0:1787764886.760054:0:9173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164373120 00000100:00100000:0.0:1787764886.760159:0:9173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 20 00000100:00100000:0.0:1787764886.760169:0:9173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfbc3077840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c035addb-e6b1-4a9c-9554-21f3e0d84883+9:9893:x1874607164373120:12345-192.168.202.53@tcp:101:touch.500 00010000:00010000:0.0:1787764886.760196:0:9173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787764886.760226:0:9173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030000/0xdf82b4f42fb37d53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2033f7a1f5725b45 expref: -99 pid: 9173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764886.760314:0:9173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030000/0xdf82b4f42fb37d53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b45 expref: 10 pid: 9173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764886.760332:0:9173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030000/0xdf82b4f42fb37d53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b45 expref: 10 pid: 9173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764886.760357:0:9173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9dfcc30a9400) 00010000:00010000:0.0:1787764886.760368:0:9173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787764886.760373:0:9173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcc0030000, rc 0) 00000100:00100000:0.0:1787764886.760438:0:9173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfbc3077840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c035addb-e6b1-4a9c-9554-21f3e0d84883+10:9893:x1874607164373120:12345-192.168.202.53@tcp:101:touch.500 Request processed in 270us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764886.760446:0:9173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 20 00000100:00100000:0.0:1787764886.764611:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764886.764701:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164373248 00000100:00100000:3.0:1787764886.764711:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164373248 00000100:00100000:3.0:1787764886.764781:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 13 00000100:00100000:3.0:1787764886.764791:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfcf8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2344:x1874607164373248:12345-192.168.202.53@tcp:8:touch.500 00010000:00080000:3.0:1787764886.764828:0:6651:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from c035addb-e6b1-4a9c-9554-21f3e0d84883@192.168.202.53@tcp t0 exp 0000000000000000 cur 225 last 0 00000020:00000080:3.0:1787764886.764877:0:6651:0:(genops.c:1385:class_connect()) connect: client c035addb-e6b1-4a9c-9554-21f3e0d84883, cookie 0xdf82b4f42fb37d5a 00002000:00100000:3.0:1787764886.764891:0:6651:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c035addb-e6b1-4a9c-9554-21f3e0d84883/ffff9dfbc1df3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113976 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787764886.764916:0:6651:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787764886.765384:0:6651:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787764886.765416:0:6651:0:(import.c:65:import_set_state_nolock()) ffff9dfbc1df2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787764886.766162:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfcf8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2344:x1874607164373248:12345-192.168.202.53@tcp:8:touch.500 Request processed in 1370us (1564us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764886.766170:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 13 00000100:00100000:1.0:1787764886.768373:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1787764886.768582:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164373376 00000100:00100000:0.0:1787764886.768592:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164373376 00000100:00080000:2.0:1787764886.768667:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787764886.768709:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 14 00000100:00100000:0.0:1787764886.768726:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfc200f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:0:x1874607164373376:12345-192.168.202.53@tcp:2:touch.500 00000001:00080000:3.0:1787764886.821812:0:6683:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:3.0:1787764886.821831:0:6683:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c035addb-e6b1-4a9c-9554-21f3e0d84883 00000100:00100000:1.0:1787764886.822020:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfc200f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+5:0:x1874607164373376:12345-192.168.202.53@tcp:2:touch.500 Request processed in 53295us (53659us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787764886.822033:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 14 00000100:00100000:2.0:1787764886.828710:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1787764886.829767:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164373632 00000100:00100000:1.0:1787764886.829778:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164373632 00000100:00100000:1.0:1787764886.829844:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 1 00000100:00100000:1.0:1787764886.829863:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfbc30752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+10:9893:x1874607164373632:12345-192.168.202.53@tcp:35:touch.500 00000100:00100000:2.0:1787764886.830326:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfbc30752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+11:9893:x1874607164373632:12345-192.168.202.53@tcp:35:touch.500 Request processed in 471us (1625us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787764886.830336:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 1 00000100:00100000:0.0:1787764886.855684:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1787764886.855881:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164373760 00000100:00100000:1.0:1787764886.855892:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164373760 00000100:00100000:1.0:1787764886.855962:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 21 00000100:00100000:1.0:1787764886.855973:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffc761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c035addb-e6b1-4a9c-9554-21f3e0d84883+11:9894:x1874607164373760:12345-192.168.202.53@tcp:101:rm.0 00010000:00010000:1.0:1787764886.856009:0:6455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787764886.856037:0:6455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35200/0xdf82b4f42fb37d61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2033f7a1f5725b4c expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.856135:0:6455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34000/0xdf82b4f42fb37d68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.856151:0:6455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34000/0xdf82b4f42fb37d68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.856163:0:6455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34000/0xdf82b4f42fb37d68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787764886.856226:0:6455:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787764886.856230:0:6455:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787764886.856272:0:6455:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34000/0xdf82b4f42fb37d68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.856299:0:6455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35200/0xdf82b4f42fb37d61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b4c expref: 13 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.856328:0:6455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34000/0xdf82b4f42fb37d68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b4c expref: 12 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.856336:0:6455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9dfce0e3cf00) 00010000:00010000:1.0:1787764886.856339:0:6455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787764886.856342:0:6455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfce1d34000, rc 0) 00000100:00100000:1.0:1787764886.856407:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffc761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c035addb-e6b1-4a9c-9554-21f3e0d84883+12:9894:x1874607164373760:12345-192.168.202.53@tcp:101:rm.0 Request processed in 436us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764886.856414:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 21 00000100:00100000:1.0:1787764886.863942:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1787764886.864027:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164374016 00000100:00100000:0.0:1787764886.864036:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164374016 00000100:00100000:0.0:1787764886.864138:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 22 00000100:00100000:0.0:1787764886.864157:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfc200000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+12:9894:x1874607164374016:12345-192.168.202.53@tcp:101:rm.0 00010000:00010000:0.0:1787764886.864177:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787764886.864204:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030600/0xdf82b4f42fb37d6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2033f7a1f5725b53 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787764886.864323:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787764886.864568:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030600/0xdf82b4f42fb37d6f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b53 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764886.864583:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dfced7f2c00) 00010000:00010000:0.0:1787764886.864586:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787764886.864591:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030600/0xdf82b4f42fb37d6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b53 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764886.864605:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcc0030600, rc 0) 00000100:00100000:0.0:1787764886.864657:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfc200000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+13:9894:x1874607164374016:12345-192.168.202.53@tcp:101:rm.0 Request processed in 511us (723us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1787764886.864665:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 22 00000100:00100000:0.0:1787764886.868370:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1787764886.868528:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164374144 00000100:00100000:2.0:1787764886.868545:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164374144 00000100:00100000:2.0:1787764886.868605:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 2 00000100:00100000:2.0:1787764886.868623:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffc743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c035addb-e6b1-4a9c-9554-21f3e0d84883+13:9894:x1874607164374144:12345-192.168.202.53@tcp:37:rm.0 00000100:00100000:0.0:1787764886.886027:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffc743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c035addb-e6b1-4a9c-9554-21f3e0d84883+13:9894:x1874607164374144:12345-192.168.202.53@tcp:37:rm.0 Request processed in 17396us (17658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764886.886041:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 2 00000100:00100000:1.0:1787764886.889844:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1787764886.889996:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164374400 00000100:00100000:0.0:1787764886.890015:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164374400 00000100:00100000:0.0:1787764886.890127:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 3 00000100:00100000:0.0:1787764886.890138:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfc201680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+13:9894:x1874607164374400:12345-192.168.202.53@tcp:35:rm.0 00000100:00100000:0.0:1787764886.890563:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfc201680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+14:9894:x1874607164374400:12345-192.168.202.53@tcp:35:rm.0 Request processed in 419us (721us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787764886.890572:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 3 00000100:00100000:2.0:1787764886.897061:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1787764886.897459:0:9173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164374656 00000100:00100000:0.0:1787764886.897490:0:9173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164374656 00000100:00100000:0.0:1787764886.897553:0:9173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 23 00000100:00100000:0.0:1787764886.897563:0:9173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfbc3076940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c035addb-e6b1-4a9c-9554-21f3e0d84883+14:9894:x1874607164374656:12345-192.168.202.53@tcp:101:rm.0 00010000:00010000:0.0:1787764886.897588:0:9173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787764886.897610:0:9173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030600/0xdf82b4f42fb37d7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2033f7a1f5725b5a expref: -99 pid: 9173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764886.897760:0:9173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030800/0xdf82b4f42fb37d84 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764886.897776:0:9173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030800/0xdf82b4f42fb37d84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764886.897787:0:9173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030800/0xdf82b4f42fb37d84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9173 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787764886.897799:0:9173:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787764886.897959:0:9173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030600/0xdf82b4f42fb37d7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b5a expref: 17 pid: 9173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764886.897978:0:9173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030800/0xdf82b4f42fb37d84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b5a expref: 16 pid: 9173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764886.897993:0:9173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9dfce0e3cf00) 00010000:00010000:0.0:1787764886.897997:0:9173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787764886.898000:0:9173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcc0030800, rc 0) 00000100:00100000:0.0:1787764886.898061:0:9173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfbc3076940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c035addb-e6b1-4a9c-9554-21f3e0d84883+16:9894:x1874607164374656:12345-192.168.202.53@tcp:101:rm.0 Request processed in 499us (1010us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787764886.898068:0:9173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 23 00000100:00100000:3.0:1787764886.902178:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1787764886.902276:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164374784 00000100:00100000:1.0:1787764886.902287:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164374784 00000100:00100000:1.0:1787764886.902346:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 24 00000100:00100000:1.0:1787764886.902367:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc77ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c035addb-e6b1-4a9c-9554-21f3e0d84883+16:9894:x1874607164374784:12345-192.168.202.53@tcp:41:rm.0 00000004:00000024:1.0:1787764886.902435:0:6455:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1787764886.902519:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc77ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c035addb-e6b1-4a9c-9554-21f3e0d84883+16:9894:x1874607164374784:12345-192.168.202.53@tcp:41:rm.0 Request processed in 163us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764886.902526:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 24 00000100:00100000:1.0:1787764886.904835:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764886.904968:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164374912 00000100:00100000:3.0:1787764886.904977:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164374912 00000100:00100000:3.0:1787764886.905031:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 25 00000100:00100000:3.0:1787764886.905040:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfc203840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c035addb-e6b1-4a9c-9554-21f3e0d84883+16:9894:x1874607164374912:12345-192.168.202.53@tcp:101:rm.0 00010000:00010000:3.0:1787764886.905059:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787764886.905078:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67000/0xdf82b4f42fb37d92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2033f7a1f5725b61 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.905173:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67e00/0xdf82b4f42fb37d99 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.905188:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67e00/0xdf82b4f42fb37d99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.905199:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67e00/0xdf82b4f42fb37d99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.905224:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab66c00/0xdf82b4f42fb37da0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.905231:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab66c00/0xdf82b4f42fb37da0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.905238:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab66c00/0xdf82b4f42fb37da0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.905449:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67200/0xdf82b4f42fb37da7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.905467:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67200/0xdf82b4f42fb37da7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.905484:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67200/0xdf82b4f42fb37da7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787764886.905510:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787764886.905515:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787764886.905538:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67200/0xdf82b4f42fb37da7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.905559:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67200/0xdf82b4f42fb37da7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.905568:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67e00/0xdf82b4f42fb37d99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.905574:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67e00/0xdf82b4f42fb37d99 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.905581:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67e00/0xdf82b4f42fb37d99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.905588:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcdab67e00 already unused, calling callback (ffffffffc20ea4f0) 00010000:00010000:3.0:1787764886.905592:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67e00/0xdf82b4f42fb37d99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.905599:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67e00/0xdf82b4f42fb37d99 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.905618:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9dfce0e3cf00) 00010000:00010000:3.0:1787764886.905621:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787764886.905627:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67e00/0xdf82b4f42fb37d99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.905634:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67e00/0xdf82b4f42fb37d99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.905975:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab66c00/0xdf82b4f42fb37da0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.905983:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab66c00/0xdf82b4f42fb37da0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.905988:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab66c00/0xdf82b4f42fb37da0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.905993:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcdab66c00 already unused, calling callback (ffffffffc20ea4f0) 00010000:00010000:3.0:1787764886.905996:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab66c00/0xdf82b4f42fb37da0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.906001:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab66c00/0xdf82b4f42fb37da0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.906010:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x94fd8476 (ffff9dfce0e3cd00) 00010000:00010000:3.0:1787764886.906012:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787764886.906015:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab66c00/0xdf82b4f42fb37da0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.906020:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab66c00/0xdf82b4f42fb37da0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.906062:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67000/0xdf82b4f42fb37d92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b61 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.906075:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67200/0xdf82b4f42fb37da7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b61 expref: 17 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.906161:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9dfcc30a9400) 00010000:00010000:3.0:1787764886.906164:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787764886.906167:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcdab67200, rc 0) 00000100:00100000:3.0:1787764886.906232:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfc203840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c035addb-e6b1-4a9c-9554-21f3e0d84883+17:9894:x1874607164374912:12345-192.168.202.53@tcp:101:rm.0 Request processed in 1192us (1403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764886.906242:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 25 00000100:00100000:2.0:1787764886.916047:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764886.917180:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164375168 00000100:00100000:3.0:1787764886.917191:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164375168 00000100:00100000:3.0:1787764886.917253:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 26 00000100:00100000:3.0:1787764886.917263:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfbc3074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+17:9894:x1874607164375168:12345-192.168.202.53@tcp:36:rm.0 00010000:00010000:3.0:1787764886.917326:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787764886.917352:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67200/0xdf82b4f42fb37da7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b61 expref: 17 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.917384:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030000/0xdf82b4f42fb37d53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b45 expref: 16 pid: 9173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.917395:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9dfcc30a9400) 00010000:00010000:3.0:1787764886.918480:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34000/0xdf82b4f42fb37d68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b4c expref: 15 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.918519:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9dfce0e3cf00) 00010000:00010000:3.0:1787764886.918523:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787764886.918544:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67600/0xdf82b4f42fb37dae lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.918557:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67600/0xdf82b4f42fb37dae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.918567:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67600/0xdf82b4f42fb37dae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.918580:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67800/0xdf82b4f42fb37db5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.918587:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67800/0xdf82b4f42fb37db5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.918593:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67800/0xdf82b4f42fb37db5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.918930:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcffc46c00/0xdf82b4f42fb37dbc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.918939:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcffc46c00/0xdf82b4f42fb37dbc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.918946:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcffc46c00/0xdf82b4f42fb37dbc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787764886.923987:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1787764886.924025:0:5808:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 225939942579ns, next at 226939937420ns, rc = 0 00010000:00010000:2.0:1787764886.924321:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3c00/0xdf82b4f42fb37dc3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764886.924339:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3c00/0xdf82b4f42fb37dc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764886.924353:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3c00/0xdf82b4f42fb37dc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764886.924373:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3c00/0xdf82b4f42fb37dc3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764886.924379:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3c00/0xdf82b4f42fb37dc3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764886.924400:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3c00/0xdf82b4f42fb37dc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764886.924415:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787764886.924442:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcffc46c00/0xdf82b4f42fb37dbc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764886.924449:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcffc46c00/0xdf82b4f42fb37dbc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764886.924454:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcffc46c00/0xdf82b4f42fb37dbc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764886.924459:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcffc46c00 already unused, calling callback (ffffffffc20ea4f0) 00010000:00010000:2.0:1787764886.924463:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcffc46c00/0xdf82b4f42fb37dbc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764886.924486:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcffc46c00/0xdf82b4f42fb37dbc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764886.924499:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9dfce0e3c400) 00010000:00010000:2.0:1787764886.924502:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787764886.924516:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcffc46c00/0xdf82b4f42fb37dbc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764886.924522:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcffc46c00/0xdf82b4f42fb37dbc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764886.924541:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67600/0xdf82b4f42fb37dae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764886.924547:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67600/0xdf82b4f42fb37dae lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764886.924567:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67600/0xdf82b4f42fb37dae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764886.924572:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcdab67600 already unused, calling callback (ffffffffc20ea4f0) 00010000:00010000:2.0:1787764886.924575:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67600/0xdf82b4f42fb37dae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764886.924581:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67600/0xdf82b4f42fb37dae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764886.924589:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9dfce0e3cf00) 00010000:00010000:2.0:1787764886.924591:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787764886.924594:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67600/0xdf82b4f42fb37dae lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764886.924599:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67600/0xdf82b4f42fb37dae lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787764886.924610:0:5808:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000695991cc reply state 00000000f0b5af08 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67800/0xdf82b4f42fb37db5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764886.924618:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787764886.924778:0:6668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787764886.924785:0:6668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3c00/0xdf82b4f42fb37dc3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.924798:0:6668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcc92b3c00 already unused, calling callback (ffffffffc16cb530) 00010000:00010000:1.0:1787764886.924801:0:6668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3c00/0xdf82b4f42fb37dc3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.924808:0:6668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3c00/0xdf82b4f42fb37dc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.924818:0:6668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9dfce0e3c400) 00010000:00010000:1.0:1787764886.924820:0:6668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787764886.924823:0:6668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3c00/0xdf82b4f42fb37dc3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.924827:0:6668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3c00/0xdf82b4f42fb37dc3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.924856:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764886.924857:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764886.924859:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764886.924898:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfbc3074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+16:9894:x1874607164375168:12345-192.168.202.53@tcp:36:rm.0 Request processed in 7633us (8860us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787764886.924908:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 26 00010000:00010000:1.0:1787764886.928051:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67800/0xdf82b4f42fb37db5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.928070:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67800/0xdf82b4f42fb37db5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.928078:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67800/0xdf82b4f42fb37db5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.928117:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcdab67800 already unused, calling callback (ffffffffc20ea4f0) 00010000:00010000:1.0:1787764886.928129:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67800/0xdf82b4f42fb37db5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.928138:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67800/0xdf82b4f42fb37db5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.928154:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x94fd8476 (ffff9dfce0e3c100) 00010000:00010000:1.0:1787764886.928157:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787764886.928161:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67800/0xdf82b4f42fb37db5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.928167:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67800/0xdf82b4f42fb37db5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764886.929445:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1787764886.929533:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164375424 00000100:00100000:0.0:1787764886.929544:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164375424 00000100:00100000:0.0:1787764886.929600:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 4 00000100:00100000:0.0:1787764886.929618:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfce5659050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+15:9894:x1874607164375424:12345-192.168.202.53@tcp:35:rm.0 00000100:00100000:0.0:1787764886.929893:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfce5659050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+16:9894:x1874607164375424:12345-192.168.202.53@tcp:35:rm.0 Request processed in 277us (452us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787764886.929901:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 4 00000100:00100000:2.0:1787764886.940719:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1787764886.940913:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164375680 00000100:00100000:0.0:1787764886.940923:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164375680 00000100:00100000:0.0:1787764886.940980:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 27 00000100:00100000:0.0:1787764886.940990:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfbc30743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+16:9894:x1874607164375680:12345-192.168.202.53@tcp:36:rm.0 00010000:00010000:0.0:1787764886.941071:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787764886.941140:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030800/0xdf82b4f42fb37d84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b5a expref: 16 pid: 9173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764886.941163:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcdab67400/0xdf82b4f42fb37d22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b37 expref: 15 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764886.941173:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9dfce0e3cf00) 00010000:00010000:0.0:1787764886.941214:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030200/0xdf82b4f42fb37ce3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b29 expref: 14 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764886.941223:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dfced7f2c00) 00010000:00010000:0.0:1787764886.941230:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787764886.941254:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030600/0xdf82b4f42fb37dca lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764886.941266:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030600/0xdf82b4f42fb37dca lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764886.941275:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030600/0xdf82b4f42fb37dca lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764886.941288:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030000/0xdf82b4f42fb37dd1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764886.941295:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030000/0xdf82b4f42fb37dd1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764886.941301:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030000/0xdf82b4f42fb37dd1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.941889:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35a00/0xdf82b4f42fb37dd8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.941899:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35a00/0xdf82b4f42fb37dd8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.941913:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35a00/0xdf82b4f42fb37dd8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787764886.942984:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787764886.943001:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35a00/0xdf82b4f42fb37dd8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.943009:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35a00/0xdf82b4f42fb37dd8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.943015:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35a00/0xdf82b4f42fb37dd8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.943021:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfce1d35a00 already unused, calling callback (ffffffffc20ea4f0) 00010000:00010000:1.0:1787764886.943025:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35a00/0xdf82b4f42fb37dd8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.943032:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35a00/0xdf82b4f42fb37dd8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.943043:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9dfced7f2b00) 00010000:00010000:1.0:1787764886.943046:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787764886.943050:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35a00/0xdf82b4f42fb37dd8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.943055:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35a00/0xdf82b4f42fb37dd8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.943078:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030600/0xdf82b4f42fb37dca lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.943326:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030600/0xdf82b4f42fb37dca lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.943341:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030600/0xdf82b4f42fb37dca lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.943346:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcc0030600 already unused, calling callback (ffffffffc20ea4f0) 00010000:00010000:1.0:1787764886.943349:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030600/0xdf82b4f42fb37dca lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.943433:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030600/0xdf82b4f42fb37dca lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.943445:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dfcc30a9100) 00010000:00010000:1.0:1787764886.943448:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787764886.943452:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030600/0xdf82b4f42fb37dca lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764886.943458:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030600/0xdf82b4f42fb37dca lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787764886.943488:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000042e22ebf reply state 00000000cf1e541b transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030000/0xdf82b4f42fb37dd1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764886.943497:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787764886.943583:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfbc30743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+15:9894:x1874607164375680:12345-192.168.202.53@tcp:36:rm.0 Request processed in 2591us (2872us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787764886.943593:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 27 00010000:00010000:3.0:1787764886.947520:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030000/0xdf82b4f42fb37dd1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.947556:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030000/0xdf82b4f42fb37dd1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.947564:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030000/0xdf82b4f42fb37dd1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.947570:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcc0030000 already unused, calling callback (ffffffffc20ea4f0) 00010000:00010000:3.0:1787764886.947575:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030000/0xdf82b4f42fb37dd1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.947584:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030000/0xdf82b4f42fb37dd1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.947600:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9dfcc30a9200) 00010000:00010000:3.0:1787764886.947602:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787764886.947607:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030000/0xdf82b4f42fb37dd1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764886.947613:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030000/0xdf82b4f42fb37dd1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764886.998265:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764887.001549:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164375808 00000100:00100000:3.0:1787764887.001565:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164375808 00000100:00100000:2.0:1787764887.001839:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 28 00000100:00100000:2.0:1787764887.001851:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfbc30752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c035addb-e6b1-4a9c-9554-21f3e0d84883+14:9898:x1874607164375808:12345-192.168.202.53@tcp:101:getfattr.0 00010000:00010000:2.0:1787764887.001889:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764887.001910:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2600/0xdf82b4f42fb37ddf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2033f7a1f5725b68 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764887.001984:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2e00/0xdf82b4f42fb37de6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764887.001998:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2e00/0xdf82b4f42fb37de6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764887.002020:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2e00/0xdf82b4f42fb37de6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787764887.002117:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787764887.002121:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787764887.002168:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2e00/0xdf82b4f42fb37de6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764887.002191:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2600/0xdf82b4f42fb37ddf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b68 expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764887.002209:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2e00/0xdf82b4f42fb37de6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b68 expref: 15 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764887.002217:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dfce034c700) 00010000:00010000:2.0:1787764887.002220:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787764887.002223:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcc92b2e00, rc 0) 00000100:00100000:2.0:1787764887.002309:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfbc30752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c035addb-e6b1-4a9c-9554-21f3e0d84883+15:9898:x1874607164375808:12345-192.168.202.53@tcp:101:getfattr.0 Request processed in 460us (4055us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764887.002316:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 28 00000100:00080000:0.0:1787764887.003165:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787764887.005202:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764887.005298:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164375936 00000100:00100000:3.0:1787764887.005308:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164375936 00000100:00100000:3.0:1787764887.005374:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00100000:3.0:1787764887.005384:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced26d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+15:9898:x1874607164375936:12345-192.168.202.53@tcp:33:getfattr.0 00000004:00200000:3.0:1787764887.005502:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787764887.005506:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000100:00100000:3.0:1787764887.005612:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced26d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+15:9898:x1874607164375936:12345-192.168.202.53@tcp:33:getfattr.0 Request processed in 229us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764887.005620:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 5 00010000:00010000:1.0:1787764887.006206:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764887.057517:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1787764887.057624:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164376192 00000100:00100000:0.0:1787764887.057632:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164376192 00000100:00100000:0.0:1787764887.057695:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 29 00000100:00100000:0.0:1787764887.057705:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced26de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+15:9903:x1874607164376192:12345-192.168.202.53@tcp:36:lfs.0 00010000:00010000:0.0:1787764887.057756:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787764887.057831:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2e00/0xdf82b4f42fb37de6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b68 expref: 15 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764887.057861:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dfce034c700) 00010000:00010000:0.0:1787764887.057869:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787764887.057892:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030200/0xdf82b4f42fb37ded lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764887.057901:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030200/0xdf82b4f42fb37ded lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764887.057908:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030200/0xdf82b4f42fb37ded lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787764887.058518:0:5808:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000022ca514c reply state 0000000037647143 transno 4294967309 ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030200/0xdf82b4f42fb37ded lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764887.058528:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787764887.058541:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787764887.058683:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced26de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+16:9903:x1874607164376192:12345-192.168.202.53@tcp:36:lfs.0 Request processed in 977us (1174us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787764887.058691:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 29 00010000:00010000:1.0:1787764887.061566:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030200/0xdf82b4f42fb37ded lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764887.061583:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030200/0xdf82b4f42fb37ded lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764887.061602:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030200/0xdf82b4f42fb37ded lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764887.061609:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcc0030200 already unused, calling callback (ffffffffc20ea4f0) 00010000:00010000:1.0:1787764887.061613:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030200/0xdf82b4f42fb37ded lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764887.061629:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030200/0xdf82b4f42fb37ded lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764887.061647:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dfcc30a9f00) 00010000:00010000:1.0:1787764887.061650:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787764887.061656:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030200/0xdf82b4f42fb37ded lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764887.061662:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc0030200/0xdf82b4f42fb37ded lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764887.071148:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1787764887.071240:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164376320 00000100:00100000:1.0:1787764887.071254:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164376320 00000100:00100000:1.0:1787764887.071319:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 30 00000100:00100000:1.0:1787764887.071330:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced26e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+15:9904:x1874607164376320:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:1.0:1787764887.071354:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787764887.071376:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35a00/0xdf82b4f42fb37df4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2033f7a1f5725b6f expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764887.071429:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34e00/0xdf82b4f42fb37dfb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764887.071439:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34e00/0xdf82b4f42fb37dfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764887.071459:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34e00/0xdf82b4f42fb37dfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787764887.071528:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787764887.071532:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787764887.071558:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34e00/0xdf82b4f42fb37dfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764887.071577:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35a00/0xdf82b4f42fb37df4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b6f expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764887.071592:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34e00/0xdf82b4f42fb37dfb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b6f expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764887.071598:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dfced7f2b00) 00010000:00010000:1.0:1787764887.071600:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787764887.071602:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfce1d34e00, rc 0) 00000100:00100000:1.0:1787764887.071654:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced26e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+16:9904:x1874607164376320:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 327us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764887.071661:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 30 00000100:00100000:2.0:1787764887.077434:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764887.078614:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164376448 00000100:00100000:3.0:1787764887.078632:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164376448 00000100:00100000:2.0:1787764887.079015:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00100000:2.0:1787764887.079029:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced26f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+16:9904:x1874607164376448:12345-192.168.202.53@tcp:33:lfs.0 00000004:00200000:2.0:1787764887.079457:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787764887.079463:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000100:00100000:2.0:1787764887.079589:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced26f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+16:9904:x1874607164376448:12345-192.168.202.53@tcp:33:lfs.0 Request processed in 562us (2162us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764887.079597:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 6 00010000:00010000:1.0:1787764888.023280:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787764888.464628:0:11671:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-compr test 2002: Compr stat is valid in case of ENOMEM ========================================================== 13:21:27 (1787764887) 00010000:00010000:1.0:1787764889.048217:0:6668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764889.706337:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1787764889.706399:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164376576 00000100:00100000:2.0:1787764889.706409:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164376576 00000100:00080000:3.0:1787764889.706468:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787764889.706581:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 31 00000100:00100000:2.0:1787764889.706594:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc77dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c035addb-e6b1-4a9c-9554-21f3e0d84883+16:10101:x1874607164376576:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:2.0:1787764889.706625:0:6455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764889.706646:0:6455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2a00/0xdf82b4f42fb37e02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2033f7a1f5725b76 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.706709:0:6455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3c00/0xdf82b4f42fb37e09 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.706733:0:6455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3c00/0xdf82b4f42fb37e09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.706746:0:6455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3c00/0xdf82b4f42fb37e09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.706794:0:6455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2200/0xdf82b4f42fb37e10 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.706810:0:6455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2200/0xdf82b4f42fb37e10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.706819:0:6455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2200/0xdf82b4f42fb37e10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.706896:0:6455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3c00/0xdf82b4f42fb37e09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.706904:0:6455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3c00/0xdf82b4f42fb37e09 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.706911:0:6455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3c00/0xdf82b4f42fb37e09 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.706917:0:6455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcc92b3c00 already unused, calling callback (ffffffffc20ea4f0) 00010000:00010000:2.0:1787764889.706921:0:6455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3c00/0xdf82b4f42fb37e09 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.706928:0:6455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3c00/0xdf82b4f42fb37e09 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.706939:0:6455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dfced7f2b00) 00010000:00010000:2.0:1787764889.706943:0:6455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787764889.706948:0:6455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3c00/0xdf82b4f42fb37e09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.706955:0:6455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3c00/0xdf82b4f42fb37e09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.706966:0:6455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2200/0xdf82b4f42fb37e10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.706978:0:6455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2200/0xdf82b4f42fb37e10 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.706984:0:6455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2200/0xdf82b4f42fb37e10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.706989:0:6455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcc92b2200 already unused, calling callback (ffffffffc20ea4f0) 00010000:00010000:2.0:1787764889.706992:0:6455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2200/0xdf82b4f42fb37e10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.706999:0:6455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2200/0xdf82b4f42fb37e10 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.707007:0:6455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf5e86211 (ffff9dfce034c300) 00010000:00010000:2.0:1787764889.707009:0:6455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787764889.707012:0:6455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2200/0xdf82b4f42fb37e10 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.707019:0:6455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2200/0xdf82b4f42fb37e10 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.707050:0:6455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2a00/0xdf82b4f42fb37e02 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b76 expref: 17 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.707264:0:6455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dfced7f2b00) 00010000:00010000:2.0:1787764889.707267:0:6455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787764889.707273:0:6455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2a00/0xdf82b4f42fb37e02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b76 expref: 17 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.707284:0:6455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcc92b2a00, rc 0) 00000100:00100000:2.0:1787764889.707346:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc77dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c035addb-e6b1-4a9c-9554-21f3e0d84883+16:10101:x1874607164376576:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 755us (1012us total) trans 0 rc 301/301 00000100:00100000:2.0:1787764889.707353:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 31 00000100:00100000:3.0:1787764889.711399:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1787764889.711487:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164376832 00000100:00100000:2.0:1787764889.711498:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164376832 00000100:00100000:2.0:1787764889.711556:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 32 00000100:00100000:2.0:1787764889.711568:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc77dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+16:10101:x1874607164376832:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:2.0:1787764889.711588:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764889.711591:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787764889.711627:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34e00/0xdf82b4f42fb37dfb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b6f expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.711645:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dfced7f2b00) 00010000:00010000:2.0:1787764889.711654:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787764889.711669:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3400/0xdf82b4f42fb37e17 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2033f7a1f5725b7d expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.711796:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3a00/0xdf82b4f42fb37e1e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.711809:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3a00/0xdf82b4f42fb37e1e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.711819:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3a00/0xdf82b4f42fb37e1e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.711845:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2600/0xdf82b4f42fb37e25 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.711852:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2600/0xdf82b4f42fb37e25 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.711868:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2600/0xdf82b4f42fb37e25 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.712511:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2e00/0xdf82b4f42fb37e2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.712523:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2e00/0xdf82b4f42fb37e2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.712531:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2e00/0xdf82b4f42fb37e2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787764889.712540:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 0 00010000:00010000:2.0:1787764889.712566:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3a00/0xdf82b4f42fb37e1e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.712572:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3a00/0xdf82b4f42fb37e1e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.712578:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3a00/0xdf82b4f42fb37e1e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.712584:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcc92b3a00 already unused, calling callback (ffffffffc20ea4f0) 00010000:00010000:2.0:1787764889.712589:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3a00/0xdf82b4f42fb37e1e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.712596:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3a00/0xdf82b4f42fb37e1e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.712605:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dfce034c200) 00010000:00010000:2.0:1787764889.712608:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787764889.712618:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3a00/0xdf82b4f42fb37e1e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.712625:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3a00/0xdf82b4f42fb37e1e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787764889.712636:0:5808:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac4d8991 reply state 000000008d754093 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2600/0xdf82b4f42fb37e25 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764889.712644:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787764889.712672:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3400/0xdf82b4f42fb37e17 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b7d expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.712689:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2e00/0xdf82b4f42fb37e2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b7d expref: 17 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.712696:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dfce034c700) 00010000:00010000:2.0:1787764889.712698:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787764889.712701:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcc92b2e00, rc 0) 00000100:00100000:2.0:1787764889.712765:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc77dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+18:10101:x1874607164376832:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 1199us (1375us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787764889.712774:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 32 00010000:00010000:1.0:1787764889.717005:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2600/0xdf82b4f42fb37e25 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.717024:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2600/0xdf82b4f42fb37e25 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.717032:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2600/0xdf82b4f42fb37e25 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.717045:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcc92b2600 already unused, calling callback (ffffffffc20ea4f0) 00010000:00010000:1.0:1787764889.717050:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2600/0xdf82b4f42fb37e25 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.717058:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2600/0xdf82b4f42fb37e25 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.717073:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf5e86211 (ffff9dfce034ca00) 00010000:00010000:1.0:1787764889.717077:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787764889.717115:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2600/0xdf82b4f42fb37e25 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.717122:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2600/0xdf82b4f42fb37e25 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764889.727240:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1787764889.727324:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164377088 00000100:00100000:1.0:1787764889.727333:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164377088 00000100:00100000:1.0:1787764889.727391:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 33 00000100:00100000:1.0:1787764889.727403:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced26d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c035addb-e6b1-4a9c-9554-21f3e0d84883+17:10101:x1874607164377088:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:1.0:1787764889.727426:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787764889.727458:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34600/0xdf82b4f42fb37e3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2033f7a1f5725b84 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.727560:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34000/0xdf82b4f42fb37e41 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.727575:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2e00/0xdf82b4f42fb37e2c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b7d expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.727595:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34000/0xdf82b4f42fb37e41 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.727626:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2e00/0xdf82b4f42fb37e2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b7d expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.727640:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2e00/0xdf82b4f42fb37e2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b7d expref: 18 pid: 5808 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764889.727653:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcfc200b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5809:1874607176994048:192.168.202.53@tcp:104: 00000100:00100000:1.0:1787764889.727740:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dfcffb43780 going to sleep for 11 seconds 00000100:00100000:2.0:1787764889.732151:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1787764889.732192:0:6286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164377216 00000100:00100000:0.0:1787764889.732202:0:6286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164377216 00010000:00010000:0.0:1787764889.732241:0:6286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2e00/0xdf82b4f42fb37e2c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b7d expref: 19 pid: 5808 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764889.732275:0:6286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 28 00000100:00100000:0.0:1787764889.732284:0:6286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfcee3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c035addb-e6b1-4a9c-9554-21f3e0d84883+19:2346:x1874607164377216:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787764889.732307:0:6286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787764889.732314:0:6286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2e00/0xdf82b4f42fb37e2c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b7d expref: 19 pid: 5808 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764889.732329:0:6286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2e00/0xdf82b4f42fb37e2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b7d expref: 19 pid: 5808 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764889.732337:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcfc200b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5809:1874607176994048:192.168.202.53@tcp:104: 00010000:00010000:0.0:1787764889.732365:0:6286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2e00/0xdf82b4f42fb37e2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b7d expref: 19 pid: 5808 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764889.733944:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34000/0xdf82b4f42fb37e41 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764889.733952:0:6286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dfce034c700) 00010000:00010000:0.0:1787764889.733960:0:6286:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34000/0xdf82b4f42fb37e41 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764889.733972:0:6286:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34000/0xdf82b4f42fb37e41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764889.733980:0:6286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34000/0xdf82b4f42fb37e41 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764889.734068:0:6286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787764889.734143:0:6286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfcee3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c035addb-e6b1-4a9c-9554-21f3e0d84883+18:2346:x1874607164377216:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 1858us (2000us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764889.734152:0:6286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 28 00010000:00010000:3.0:1787764889.734477:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34000/0xdf82b4f42fb37e41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764889.734486:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34000/0xdf82b4f42fb37e41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787764889.734504:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 0 00000004:00080000:3.0:1787764889.734792:0:5809:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1787764889.736414:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34000/0xdf82b4f42fb37e41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764889.736428:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34000/0xdf82b4f42fb37e41 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764889.736434:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34000/0xdf82b4f42fb37e41 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764889.736441:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfce1d34000 already unused, calling callback (ffffffffc20ea4f0) 00010000:00010000:3.0:1787764889.736456:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34000/0xdf82b4f42fb37e41 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764889.736471:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34000/0xdf82b4f42fb37e41 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764889.736489:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dfce034c700) 00010000:00010000:3.0:1787764889.736491:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787764889.736496:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34000/0xdf82b4f42fb37e41 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764889.736503:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34000/0xdf82b4f42fb37e41 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764889.736563:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34600/0xdf82b4f42fb37e3a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b84 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764889.736573:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dfced7f2400) 00010000:00010000:3.0:1787764889.736576:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787764889.736580:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34600/0xdf82b4f42fb37e3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b84 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764889.736591:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfce1d34600, rc 0) 00000100:00100000:3.0:1787764889.736686:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced26d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c035addb-e6b1-4a9c-9554-21f3e0d84883+17:10101:x1874607164377088:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 9285us (9453us total) trans 4294967311 rc 301/301 00000100:00100000:3.0:1787764889.736694:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 33 00000100:00100000:2.0:1787764889.747763:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1787764889.747823:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164377472 00000100:00100000:0.0:1787764889.747834:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164377472 00000100:00100000:0.0:1787764889.747890:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:0.0:1787764889.747898:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfcee12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c035addb-e6b1-4a9c-9554-21f3e0d84883+17:10101:x1874607164377472:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:0.0:1787764889.748226:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfcee12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c035addb-e6b1-4a9c-9554-21f3e0d84883+18:10101:x1874607164377472:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 327us (471us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787764889.748231:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:0.0:1787764889.749350:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1787764889.749492:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164377728 00000100:00100000:2.0:1787764889.749498:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164377728 00000100:00100000:2.0:1787764889.749541:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 8 00000100:00100000:2.0:1787764889.749551:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffc743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+18:10101:x1874607164377728:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:2.0:1787764889.749694:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffc743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+19:10101:x1874607164377728:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 144us (364us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1787764889.749703:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 8 00000004:00080000:1.0:1787764889.818690:0:6681:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 228834605481ns, next at 229834603186ns, rc = 0 00000100:00100000:2.0:1787764889.818738:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787764889.818762:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcfc200780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176994176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787764889.818835:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764889.818947:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176994176 00000100:00100000:3.0:1787764889.818955:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176994176 00000100:00100000:3.0:1787764889.819032:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787764889.819042:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfcee1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607176994176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787764889.819107:0:6655:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787764889.819171:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfcee1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607176994176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764889.819178:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1787764889.819298:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dfcfc200780 x1874607176994176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764905 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764889.819316:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcfc200780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607176994176:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787764889.820504:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787764889.971193:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1787764889.971266:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164377856 00000100:00100000:2.0:1787764889.971277:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164377856 00000100:00100000:2.0:1787764889.971344:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 34 00000100:00100000:2.0:1787764889.971354:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfc202940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c035addb-e6b1-4a9c-9554-21f3e0d84883+19:10104:x1874607164377856:12345-192.168.202.53@tcp:101:dd.0 00010000:00010000:2.0:1787764889.971380:0:6455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764889.971401:0:6455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3a00/0xdf82b4f42fb37e4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2033f7a1f5725b8b expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.971503:0:6455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2a00/0xdf82b4f42fb37e56 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.971518:0:6455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2a00/0xdf82b4f42fb37e56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.971530:0:6455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2a00/0xdf82b4f42fb37e56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787764889.971588:0:6455:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787764889.971606:0:6455:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787764889.971656:0:6455:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2a00/0xdf82b4f42fb37e56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.971680:0:6455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3a00/0xdf82b4f42fb37e4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b8b expref: 21 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.971694:0:6455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2a00/0xdf82b4f42fb37e56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b8b expref: 20 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.971700:0:6455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dfce034c800) 00010000:00010000:2.0:1787764889.971702:0:6455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787764889.971705:0:6455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcc92b2a00, rc 0) 00000100:00100000:2.0:1787764889.971761:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfc202940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c035addb-e6b1-4a9c-9554-21f3e0d84883+20:10104:x1874607164377856:12345-192.168.202.53@tcp:101:dd.0 Request processed in 409us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764889.971767:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 34 00000100:00100000:3.0:1787764889.974756:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1787764889.974824:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164378112 00000100:00100000:1.0:1787764889.974833:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164378112 00000100:00100000:1.0:1787764889.974883:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 35 00000100:00100000:1.0:1787764889.974894:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc77dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+20:10104:x1874607164378112:12345-192.168.202.53@tcp:101:dd.0 00010000:00010000:1.0:1787764889.974914:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787764889.974916:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787764889.974939:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b2a00/0xdf82b4f42fb37e56 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b8b expref: 20 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.974957:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dfce034c800) 00010000:00010000:1.0:1787764889.974966:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787764889.974979:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35a00/0xdf82b4f42fb37e5d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2033f7a1f5725b92 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.975155:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34c00/0xdf82b4f42fb37e64 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.975167:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34c00/0xdf82b4f42fb37e64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.975177:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34c00/0xdf82b4f42fb37e64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.975191:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34800/0xdf82b4f42fb37e6b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.975198:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34800/0xdf82b4f42fb37e6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.975205:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34800/0xdf82b4f42fb37e6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.975268:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34e00/0xdf82b4f42fb37e72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.975277:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34e00/0xdf82b4f42fb37e72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.975284:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34e00/0xdf82b4f42fb37e72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787764889.975294:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 0 00010000:00010000:1.0:1787764889.975376:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34c00/0xdf82b4f42fb37e64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.975384:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34c00/0xdf82b4f42fb37e64 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.975396:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34c00/0xdf82b4f42fb37e64 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.975402:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfce1d34c00 already unused, calling callback (ffffffffc20ea4f0) 00010000:00010000:1.0:1787764889.975406:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34c00/0xdf82b4f42fb37e64 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.975414:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34c00/0xdf82b4f42fb37e64 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.975422:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dfced7f2400) 00010000:00010000:1.0:1787764889.975425:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787764889.975429:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34c00/0xdf82b4f42fb37e64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.975435:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34c00/0xdf82b4f42fb37e64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.975477:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34800/0xdf82b4f42fb37e6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.975484:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34800/0xdf82b4f42fb37e6b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.975490:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34800/0xdf82b4f42fb37e6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.975495:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfce1d34800 already unused, calling callback (ffffffffc20ea4f0) 00010000:00010000:1.0:1787764889.975498:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34800/0xdf82b4f42fb37e6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.975516:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34800/0xdf82b4f42fb37e6b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.975526:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf5e86211 (ffff9dfced7f2b00) 00010000:00010000:1.0:1787764889.975529:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787764889.975532:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34800/0xdf82b4f42fb37e6b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.975539:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34800/0xdf82b4f42fb37e6b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.975574:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d35a00/0xdf82b4f42fb37e5d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b92 expref: 22 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.975591:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34e00/0xdf82b4f42fb37e72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b92 expref: 21 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.975598:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dfced7f2c00) 00010000:00010000:1.0:1787764889.975601:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787764889.975603:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfce1d34e00, rc 0) 00000100:00100000:1.0:1787764889.975655:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc77dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+21:10104:x1874607164378112:12345-192.168.202.53@tcp:101:dd.0 Request processed in 764us (909us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787764889.975662:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 35 00000100:00100000:0.0:1787764889.977900:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764889.978165:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164378368 00000100:00100000:3.0:1787764889.978174:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164378368 00000100:00100000:3.0:1787764889.978225:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 36 00000100:00100000:3.0:1787764889.978237:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffc75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c035addb-e6b1-4a9c-9554-21f3e0d84883+21:10104:x1874607164378368:12345-192.168.202.53@tcp:36:dd.0 00010000:00010000:3.0:1787764889.978284:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787764889.978305:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfce1d34e00/0xdf82b4f42fb37e72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b92 expref: 21 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764889.978321:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dfced7f2c00) 00010000:00010000:3.0:1787764889.978330:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787764889.978532:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcffc47a00/0xdf82b4f42fb37e80 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764889.978544:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcffc47a00/0xdf82b4f42fb37e80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764889.978556:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcffc47a00/0xdf82b4f42fb37e80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787764889.978617:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967315 00000004:00010000:3.0:1787764889.978652:0:5809:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004bce0896 reply state 00000000465e47f9 transno 4294967316 ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcffc47a00/0xdf82b4f42fb37e80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764889.978661:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787764889.978751:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffc75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c035addb-e6b1-4a9c-9554-21f3e0d84883+23:10104:x1874607164378368:12345-192.168.202.53@tcp:36:dd.0 Request processed in 516us (857us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787764889.978773:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 36 00000020:00080000:3.0:1787764889.978778:0:5809:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787764889.980115:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcffc47a00/0xdf82b4f42fb37e80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.980129:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcffc47a00/0xdf82b4f42fb37e80 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.980149:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcffc47a00/0xdf82b4f42fb37e80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.980156:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfcffc47a00 already unused, calling callback (ffffffffc20ea4f0) 00010000:00010000:1.0:1787764889.980160:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcffc47a00/0xdf82b4f42fb37e80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.980168:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcffc47a00/0xdf82b4f42fb37e80 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.980181:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dfce0e3c300) 00010000:00010000:1.0:1787764889.980184:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787764889.980188:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcffc47a00/0xdf82b4f42fb37e80 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764889.980195:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcffc47a00/0xdf82b4f42fb37e80 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764889.981370:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1787764889.981424:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164378496 00000100:00100000:2.0:1787764889.981432:0:6455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164378496 00000100:00100000:2.0:1787764889.981497:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 37 00000100:00100000:2.0:1787764889.981508:0:6455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffc77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c035addb-e6b1-4a9c-9554-21f3e0d84883+22:10104:x1874607164378496:12345-192.168.202.53@tcp:101:dd.0 00010000:00010000:2.0:1787764889.981529:0:6455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764889.981544:0:6455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3c00/0xdf82b4f42fb37e87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2033f7a1f5725b99 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.981599:0:6455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3c00/0xdf82b4f42fb37e87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b99 expref: 23 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.981611:0:6455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dfcc92b3c00/0xdf82b4f42fb37e87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725b99 expref: 23 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764889.981636:0:6455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dfce034c200) 00010000:00010000:2.0:1787764889.981638:0:6455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787764889.981641:0:6455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcc92b3c00, rc 0) 00000100:00100000:2.0:1787764889.981680:0:6455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffc77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c035addb-e6b1-4a9c-9554-21f3e0d84883+23:10104:x1874607164378496:12345-192.168.202.53@tcp:101:dd.0 Request processed in 176us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764889.981685:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 37 00000100:00100000:2.0:1787764889.983220:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1787764889.983279:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164378624 00000100:00100000:0.0:1787764889.983287:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164378624 00000100:00080000:3.0:1787764889.983797:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787764889.983831:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 15 00000100:00100000:0.0:1787764889.983849:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfcee2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c035addb-e6b1-4a9c-9554-21f3e0d84883+5:10104:x1874607164378624:12345-192.168.202.53@tcp:101:dd.0 00010000:00010000:0.0:1787764889.983868:0:6653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787764889.983891:0:6653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d9af226/0xdf82b4f42fb37e8e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2033f7a1f5725ba0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787764889.983919:0:6653:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787764889.983937:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=228s v=(0 0) 00010000:00010000:0.0:1787764889.983942:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787764889.983950:0:6653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d9af226/0xdf82b4f42fb37e8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725ba0 expref: 6 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764889.983968:0:6653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005d9af226/0xdf82b4f42fb37e8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.53@tcp remote: 0x2033f7a1f5725ba0 expref: 6 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764889.983982:0:6653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dfcc0030000, rc 0) 00000100:00100000:0.0:1787764889.984042:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfcee2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:10104:x1874607164378624:12345-192.168.202.53@tcp:101:dd.0 Request processed in 196us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764889.984063:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 15 00000100:00100000:3.0:1787764889.985282:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1787764889.985356:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164378752 00000100:00100000:2.0:1787764889.985364:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164378752 00002000:00010000:2.0:1787764889.985391:0:6657:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1787764889.985396:0:6657:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9dfcc77dfc00 with x1874607164378752 ext(0->18446744073709551615) 00002000:00010000:2.0:1787764889.985405:0:6657:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dfcc77dfc00. 00000100:00100000:2.0:1787764889.985431:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 0 00000100:00100000:2.0:1787764889.985437:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcc77dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:2347:x1874607164378752:12345-192.168.202.53@tcp:10:dd.0 00002000:00010000:2.0:1787764889.985915:0:6657:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787764889.985919:0:6657:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787764889 00002000:00010000:2.0:1787764889.985921:0:6657:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787764889.985923:0:6657:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787764889 00002000:00010000:2.0:1787764889.985925:0:6657:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787764889.985975:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcc77dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+7:2347:x1874607164378752:12345-192.168.202.53@tcp:10:dd.0 Request processed in 531us (689us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787764889.985983:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 0 00002000:00010000:2.0:1787764889.985987:0:6657:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1787764889.985990:0:6657:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9dfcc77dfc00 with x1874607164378752 ext(0->18446744073709551615) 00002000:00010000:2.0:1787764889.985996:0:6657:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dfcc77dfc00. 00010000:00010000:0.0:1787764890.071431:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787764890.071551:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764890.071616:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164378880 00000100:00100000:3.0:1787764890.071624:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164378880 00002000:00100000:3.0:1787764890.071666:0:6659:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->528383) req@ffff9dfcfc203480 x1874607164378880/t0(0) o4->c035addb-e6b1-4a9c-9554-21f3e0d84883@192.168.202.53@tcp:401/0 lens 504/0 e 0 to 0 dl 1787764901 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787764890.071678:0:6659:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9dfcfc203480 with x1874607164378880 ext(0->528383) 00002000:00010000:3.0:1787764890.071683:0:6659:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dfcfc203480 00000100:00100000:3.0:1787764890.071711:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 1 00000100:00100000:3.0:1787764890.071723:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfc203480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+7:2347:x1874607164378880:12345-192.168.202.53@tcp:4:dd.0 00000100:00100000:3.0:1787764890.073275:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfc203480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+9:2347:x1874607164378880:12345-192.168.202.53@tcp:4:dd.0 Request processed in 1550us (1725us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787764890.073286:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 1 00002000:00100000:3.0:1787764890.073296:0:6659:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->528383) req@ffff9dfcfc203480 x1874607164378880/t4294967301(0) o4->c035addb-e6b1-4a9c-9554-21f3e0d84883@192.168.202.53@tcp:401/0 lens 504/448 e 0 to 0 dl 1787764901 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787764890.073306:0:6659:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9dfcfc203480 with x1874607164378880 ext(0->528383) 00002000:00010000:3.0:1787764890.073310:0:6659:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dfcfc203480 00000100:00100000:2.0:1787764890.099669:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1787764890.099740:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164379008 00000100:00100000:0.0:1787764890.099751:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164379008 00002000:00100000:0.0:1787764890.099796:0:6657:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (1048576->1576959) req@ffff9dfcfcee0780 x1874607164379008/t0(0) o4->c035addb-e6b1-4a9c-9554-21f3e0d84883@192.168.202.53@tcp:401/0 lens 504/0 e 0 to 0 dl 1787764901 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787764890.099808:0:6657:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9dfcfcee0780 with x1874607164379008 ext(1048576->1576959) 00002000:00010000:0.0:1787764890.099813:0:6657:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dfcfcee0780 00000100:00100000:0.0:1787764890.099846:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 2 00000100:00100000:0.0:1787764890.099857:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfcee0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+9:2347:x1874607164379008:12345-192.168.202.53@tcp:4:dd.0 00000100:00100000:0.0:1787764890.101161:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfcee0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+11:2347:x1874607164379008:12345-192.168.202.53@tcp:4:dd.0 Request processed in 1301us (1496us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787764890.101172:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 2 00002000:00100000:0.0:1787764890.101183:0:6657:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (1048576->1576959) req@ffff9dfcfcee0780 x1874607164379008/t4294967302(0) o4->c035addb-e6b1-4a9c-9554-21f3e0d84883@192.168.202.53@tcp:401/0 lens 504/448 e 0 to 0 dl 1787764901 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787764890.101194:0:6657:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9dfcfcee0780 with x1874607164379008 ext(1048576->1576959) 00002000:00010000:0.0:1787764890.101199:0:6657:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dfcfcee0780 00000100:00100000:1.0:1787764890.132777:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764890.133033:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164379136 00000100:00100000:3.0:1787764890.133046:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164379136 00002000:00100000:3.0:1787764890.133312:0:6659:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (2097152->2625535) req@ffff9dfcfc200780 x1874607164379136/t0(0) o4->c035addb-e6b1-4a9c-9554-21f3e0d84883@192.168.202.53@tcp:401/0 lens 504/0 e 0 to 0 dl 1787764901 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787764890.133383:0:6659:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9dfcfc200780 with x1874607164379136 ext(2097152->2625535) 00002000:00010000:3.0:1787764890.133410:0:6659:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dfcfc200780 00000100:00100000:3.0:1787764890.133563:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 3 00000100:00100000:3.0:1787764890.133711:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfc200780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+11:2347:x1874607164379136:12345-192.168.202.53@tcp:4:dd.0 00000100:00100000:3.0:1787764890.136402:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfc200780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+13:2347:x1874607164379136:12345-192.168.202.53@tcp:4:dd.0 Request processed in 2685us (3627us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787764890.136416:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 3 00002000:00100000:3.0:1787764890.136427:0:6659:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (2097152->2625535) req@ffff9dfcfc200780 x1874607164379136/t4294967303(0) o4->c035addb-e6b1-4a9c-9554-21f3e0d84883@192.168.202.53@tcp:401/0 lens 504/448 e 0 to 0 dl 1787764901 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787764890.136437:0:6659:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9dfcfc200780 with x1874607164379136 ext(2097152->2625535) 00002000:00010000:3.0:1787764890.136459:0:6659:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dfcfc200780 00000100:00100000:1.0:1787764890.159298:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1787764890.159851:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164379264 00000100:00100000:0.0:1787764890.159867:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164379264 00002000:00100000:0.0:1787764890.159948:0:6657:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (3145728->3674111) req@ffff9dfcfc200b40 x1874607164379264/t0(0) o4->c035addb-e6b1-4a9c-9554-21f3e0d84883@192.168.202.53@tcp:401/0 lens 504/0 e 0 to 0 dl 1787764901 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787764890.159974:0:6657:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9dfcfc200b40 with x1874607164379264 ext(3145728->3674111) 00002000:00010000:0.0:1787764890.159981:0:6657:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dfcfc200b40 00000100:00100000:0.0:1787764890.160021:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 4 00000100:00100000:0.0:1787764890.160053:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfc200b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+13:2347:x1874607164379264:12345-192.168.202.53@tcp:4:dd.0 00000100:00100000:0.0:1787764890.162062:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfc200b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+15:2347:x1874607164379264:12345-192.168.202.53@tcp:4:dd.0 Request processed in 2001us (2762us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787764890.162076:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 4 00002000:00100000:0.0:1787764890.162119:0:6657:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (3145728->3674111) req@ffff9dfcfc200b40 x1874607164379264/t4294967304(0) o4->c035addb-e6b1-4a9c-9554-21f3e0d84883@192.168.202.53@tcp:401/0 lens 504/448 e 0 to 0 dl 1787764901 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787764890.162130:0:6657:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9dfcfc200b40 with x1874607164379264 ext(3145728->3674111) 00002000:00010000:0.0:1787764890.162137:0:6657:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dfcfc200b40 00000100:00100000:2.0:1787764890.184208:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764890.184266:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164379392 00000100:00100000:3.0:1787764890.184276:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164379392 00002000:00100000:3.0:1787764890.184327:0:6659:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (4194304->4722687) req@ffff9dfcfcee2d00 x1874607164379392/t0(0) o4->c035addb-e6b1-4a9c-9554-21f3e0d84883@192.168.202.53@tcp:401/0 lens 504/0 e 0 to 0 dl 1787764901 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787764890.184338:0:6659:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9dfcfcee2d00 with x1874607164379392 ext(4194304->4722687) 00002000:00010000:3.0:1787764890.184343:0:6659:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dfcfcee2d00 00000100:00100000:3.0:1787764890.184382:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00100000:3.0:1787764890.184391:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfcee2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+15:2348:x1874607164379392:12345-192.168.202.53@tcp:4:dd.0 00000100:00100000:3.0:1787764890.186115:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfcee2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+17:2348:x1874607164379392:12345-192.168.202.53@tcp:4:dd.0 Request processed in 1687us (1878us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787764890.186135:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 5 00002000:00100000:3.0:1787764890.186146:0:6659:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (4194304->4722687) req@ffff9dfcfcee2d00 x1874607164379392/t4294967305(0) o4->c035addb-e6b1-4a9c-9554-21f3e0d84883@192.168.202.53@tcp:401/0 lens 504/448 e 0 to 0 dl 1787764901 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787764890.186174:0:6659:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9dfcfcee2d00 with x1874607164379392 ext(4194304->4722687) 00002000:00010000:3.0:1787764890.186179:0:6659:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dfcfcee2d00 00000100:00100000:1.0:1787764890.204047:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1787764890.204135:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164379520 00000100:00100000:0.0:1787764890.204149:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164379520 00002000:00100000:0.0:1787764890.204220:0:6657:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (5242880->6291455) req@ffff9dfcfc201680 x1874607164379520/t0(0) o4->c035addb-e6b1-4a9c-9554-21f3e0d84883@192.168.202.53@tcp:401/0 lens 488/0 e 0 to 0 dl 1787764901 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787764890.204233:0:6657:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9dfcfc201680 with x1874607164379520 ext(5242880->6291455) 00002000:00010000:0.0:1787764890.204239:0:6657:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dfcfc201680 00000100:00100000:0.0:1787764890.204280:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00100000:0.0:1787764890.204294:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfc201680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+17:2345:x1874607164379520:12345-192.168.202.53@tcp:4:dd.0 00000100:00100000:2.0:1787764890.214896:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfc201680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+19:2345:x1874607164379520:12345-192.168.202.53@tcp:4:dd.0 Request processed in 10593us (10851us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787764890.214911:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 6 00002000:00100000:2.0:1787764890.214927:0:6657:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (5242880->6291455) req@ffff9dfcfc201680 x1874607164379520/t4294967306(0) o4->c035addb-e6b1-4a9c-9554-21f3e0d84883@192.168.202.53@tcp:401/0 lens 488/448 e 0 to 0 dl 1787764901 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787764890.214939:0:6657:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9dfcfc201680 with x1874607164379520 ext(5242880->6291455) 00002000:00010000:2.0:1787764890.214946:0:6657:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dfcfc201680 00000100:00100000:1.0:1787764890.215964:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1787764890.216025:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1787764890.216373:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164379776 00000100:00100000:0.0:1787764890.216378:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164379648 00000100:00100000:3.0:1787764890.216384:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164379776 00000100:00100000:0.0:1787764890.216386:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164379648 00002000:00100000:0.0:1787764890.216453:0:6658:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (6291456->7340031) req@ffff9dfced26f480 x1874607164379648/t0(0) o4->c035addb-e6b1-4a9c-9554-21f3e0d84883@192.168.202.53@tcp:401/0 lens 488/0 e 0 to 0 dl 1787764901 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787764890.216454:0:6659:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (7340032->8388607) req@ffff9dfcfc203c00 x1874607164379776/t0(0) o4->c035addb-e6b1-4a9c-9554-21f3e0d84883@192.168.202.53@tcp:401/0 lens 488/0 e 0 to 0 dl 1787764901 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787764890.216473:0:6659:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9dfcfc203c00 with x1874607164379776 ext(7340032->8388607) 00002000:00100000:0.0:1787764890.216479:0:6658:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9dfced26f480 with x1874607164379648 ext(6291456->7340031) 00002000:00010000:3.0:1787764890.216481:0:6659:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dfcfc203c00 00002000:00010000:0.0:1787764890.216486:0:6658:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dfced26f480 00000100:00100000:3.0:1787764890.216520:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:3.0:1787764890.216533:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcfc203c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+20:2346:x1874607164379776:12345-192.168.202.53@tcp:4:dd.0 00000100:00100000:1.0:1787764890.235935:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcfc203c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+22:2346:x1874607164379776:12345-192.168.202.53@tcp:4:dd.0 Request processed in 19390us (19964us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787764890.235960:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 7 00002000:00100000:1.0:1787764890.235976:0:6659:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (7340032->8388607) req@ffff9dfcfc203c00 x1874607164379776/t4294967307(0) o4->c035addb-e6b1-4a9c-9554-21f3e0d84883@192.168.202.53@tcp:401/0 lens 488/448 e 0 to 0 dl 1787764901 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787764890.236005:0:6659:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9dfcfc203c00 with x1874607164379776 ext(7340032->8388607) 00002000:00010000:1.0:1787764890.236013:0:6659:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dfcfc203c00 00000100:00100000:1.0:1787764890.236052:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 8 00000100:00100000:1.0:1787764890.236067:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfced26f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+21:2348:x1874607164379648:12345-192.168.202.53@tcp:4:dd.0 00000100:00100000:0.0:1787764890.246681:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1787764890.246737:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1787764890.247034:0:6658:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1787764890.247048:0:6658:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1787764890.247144:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787764890.247158:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164379904 00000100:00100000:2.0:1787764890.247170:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164379904 00002000:00100000:2.0:1787764890.247235:0:6657:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (8388608->9437183) req@ffff9dfcffc752c0 x1874607164379904/t0(0) o4->c035addb-e6b1-4a9c-9554-21f3e0d84883@192.168.202.53@tcp:401/0 lens 488/0 e 0 to 0 dl 1787764901 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787764890.247248:0:6657:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9dfcffc752c0 with x1874607164379904 ext(8388608->9437183) 00002000:00010000:2.0:1787764890.247255:0:6657:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dfcffc752c0 00000100:00100000:2.0:1787764890.247276:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787764890.247283:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164380032 00000100:00100000:2.0:1787764890.247286:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164380032 00002000:00100000:2.0:1787764890.247301:0:6657:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (9437184->10485759) req@ffff9dfcffc75e00 x1874607164380032/t0(0) o4->c035addb-e6b1-4a9c-9554-21f3e0d84883@192.168.202.53@tcp:401/0 lens 488/0 e 0 to 0 dl 1787764901 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787764890.247310:0:6657:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9dfcffc75e00 with x1874607164380032 ext(9437184->10485759) 00002000:00010000:2.0:1787764890.247313:0:6657:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dfcffc75e00 00000100:00100000:3.0:1787764890.249180:0:11731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00100000:0.0:1787764890.249248:0:11731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffc752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c035addb-e6b1-4a9c-9554-21f3e0d84883+24:2347:x1874607164379904:12345-192.168.202.53@tcp:4:dd.0 00000100:00100000:2.0:1787764890.258430:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfced26f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+26:2348:x1874607164379648:12345-192.168.202.53@tcp:4:dd.0 Request processed in 22350us (42394us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787764890.258960:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 8 00002000:00100000:2.0:1787764890.258989:0:6659:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (6291456->7340031) req@ffff9dfced26f480 x1874607164379648/t4294967308(0) o4->c035addb-e6b1-4a9c-9554-21f3e0d84883@192.168.202.53@tcp:401/0 lens 488/448 e 0 to 0 dl 1787764901 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787764890.259002:0:6659:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9dfced26f480 with x1874607164379648 ext(6291456->7340031) 00002000:00010000:2.0:1787764890.259009:0:6659:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dfced26f480 00000100:00100000:2.0:1787764890.259050:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 10 00000100:00100000:2.0:1787764890.259066:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffc75e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+25:2347:x1874607164380032:12345-192.168.202.53@tcp:4:dd.0 00000100:00100000:1.0:1787764890.276612:0:11731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffc752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c035addb-e6b1-4a9c-9554-21f3e0d84883+27:2347:x1874607164379904:12345-192.168.202.53@tcp:4:dd.0 Request processed in 27401us (29929us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787764890.276632:0:11731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 9 00002000:00100000:1.0:1787764890.276650:0:11731:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3:0x0] (8388608->9437183) req@ffff9dfcffc752c0 x1874607164379904/t4294967309(0) o4->c035addb-e6b1-4a9c-9554-21f3e0d84883@192.168.202.53@tcp:401/0 lens 488/448 e 0 to 0 dl 1787764901 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787764890.276663:0:11731:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9dfcffc752c0 with x1874607164379904 ext(8388608->9437183) 00002000:00010000:1.0:1787764890.276671:0:11731:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dfcffc752c0 00000100:00100000:2.0:1787764890.281144:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffc75e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+27:2347:x1874607164380032:12345-192.168.202.53@tcp:4:dd.0 Request processed in 22069us (34390us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787764890.281163:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 10 00002000:00100000:2.0:1787764890.281179:0:6659:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (9437184->10485759) req@ffff9dfcffc75e00 x1874607164380032/t4294967310(0) o4->c035addb-e6b1-4a9c-9554-21f3e0d84883@192.168.202.53@tcp:401/0 lens 488/448 e 0 to 0 dl 1787764901 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787764890.281190:0:6659:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9dfcffc75e00 with x1874607164380032 ext(9437184->10485759) 00002000:00010000:2.0:1787764890.281198:0:6659:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dfcffc75e00 00000100:00100000:0.0:1787764890.284395:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1787764890.284582:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164380160 00000100:00100000:1.0:1787764890.284594:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164380160 00000100:00100000:1.0:1787764890.284664:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 38 00000100:00100000:1.0:1787764890.284676:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffc76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+23:10104:x1874607164380160:12345-192.168.202.53@tcp:44:dd.0 00000001:00080000:0.0:1787764890.319568:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967312 is committed 00000001:00080000:0.0:1787764890.319605:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967314 is committed 00000004:00080000:0.0:1787764890.319611:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1787764890.319638:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967316 is committed 00000004:00080000:0.0:1787764890.319648:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1787764890.319797:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787764890.319821:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dfcfcee0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176994304:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787764890.323035:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764890.323274:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffc76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c035addb-e6b1-4a9c-9554-21f3e0d84883+6:10104:x1874607164380160:12345-192.168.202.53@tcp:44:dd.0 Request processed in 38592us (38884us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764890.323291:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 38 00000100:00100000:1.0:1787764890.323317:0:6794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607176994304 00000100:00100000:1.0:1787764890.323326:0:6794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607176994304 00000100:00100000:1.0:1787764890.323421:0:6794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787764890.323432:0:6794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcffc74780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607176994304:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787764890.323482:0:6794:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1787764890.323524:0:6794:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a8f2096, atime: 0x6a8f2096, ctime: 0x6a8f2096, blocks: 0x1 00010000:00010000:1.0:1787764890.323533:0:6794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031b8ef26/0xdf82b4f42fb37e95 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764890.323567:0:6794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=229s v=(0 0) 00010000:00010000:1.0:1787764890.323573:0:6794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787764890.323580:0:6794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031b8ef26/0xdf82b4f42fb37e95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764890.323597:0:6794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031b8ef26/0xdf82b4f42fb37e95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764890.323608:0:6794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031b8ef26/0xdf82b4f42fb37e95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764890.323617:0:6794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031b8ef26/0xdf82b4f42fb37e95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764890.323639:0:6794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787764890.323663:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787764890.323673:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031b8ef26/0xdf82b4f42fb37e95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764890.323685:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dfce1d34800 already unused, calling callback (ffffffffc16cb530) 00010000:00010000:3.0:1787764890.323690:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031b8ef26/0xdf82b4f42fb37e95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764890.323701:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031b8ef26/0xdf82b4f42fb37e95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764890.323722:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031b8ef26/0xdf82b4f42fb37e95 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764890.323742:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031b8ef26/0xdf82b4f42fb37e95 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764890.323765:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764890.323767:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764890.323769:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787764890.324340:0:6794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dfcffc74780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3289:x1874607176994304:12345-0@lo:6:osp-syn-0-0.0 Request processed in 907us (1312us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787764890.324349:0:6794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:1.0:1787764890.324667:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dfcfcee0f00/2, rc 0, transno 4294967311 00000100:00100000:1.0:1787764890.324676:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dfcfcee0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607176994304:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787764890.328057:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1787764890.328177:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607164380288 00000100:00100000:0.0:1787764890.328189:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607164380288 00000100:00100000:0.0:1787764890.328254:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00100000:0.0:1787764890.328265:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dfcdaa92580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c035addb-e6b1-4a9c-9554-21f3e0d84883+27:2345:x1874607164380288:12345-192.168.202.53@tcp:16:dd.0 Debug log: 9262 lines, 9262 kept, 0 dropped, 0 bad.